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PREFACE 

The task of giving tests, establishing averages, and calculating 
relations, which shall serve as a basis for prognosis of mental 
ability, is, in every sense, a social undertaking, and it is only 
because of the kindly codperation of the principals, teachers, 
and pupils of the two schools studied that it has been possible 
to secure the data that supply the material for this investigation. 
The evaluation of the data has equally been a social task and I 
am particularly indebted to Professors E. L. Thomdike, S. S. 
Colvin, and H. A. Ruger for assistance in grading the preferences 
of pupils in the interest test as to vocations, sports, and enter- 
tainments, and to Mrs. Grace Osgood and Miss Grace Kelley for 
the unique assistance which, as librarians, they were able to 
render in grading magazines and books. 

To the ever-ready, stimulating criticisms of Professor Thom- 
dike, I am peculiarly indebted, for it is due to his encouragement 
that the investigation covers the three fields of mathematics, 
English, and history instead of one only, and that the number 
of relations determined is as extensive as it is. The field covered 
gives the work whatever of value it has, but the accomplishment 
of it and its appearance in print at this time has been possible only 
because of the devoted and untiring assistance, in grading, 
calculating coefficients of correlation, and deriving regression 
equations, rendered by my wife. 

September, 1914. T. L. Kelley. 
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SECTION 1.— STATEMENT OF THE PROBLEM *• 

Humanity's unvoiced plea for guidance is the foundation of 
all professions. The doctor, the lawyer, the minister find that 
belief and obedience are more often the result of need than of 
imderstanding and conviction. The modem idea of education 
is crystallizing into an effort to guide rather than to instruct — to 
answer to a need rather than to cater to a curriculum. The 
growing recognition of the need for vocational and educational 
guidance is resulting in the establishment of bureaus endeavoring 
to give the former, and in the training of psychologists to solve 
the problems of the latter. 

The movement for vocational guidance is in its infancy, but 
it only depends upon improved methods and more extended 
research to give it a place with the older professions. Vocational 
guidance has spnmg up out of two needs — ^the need of the em- 
ployer for efficient clerks, mechanics, and laborers and, still more 
important, the need of the individual to utilize his talents to the 
best advantage in order to cope with present-day industrial con- 
ditions. 

This latter demand is most pressing at the time that the 
individual is about to leave school, and it is at this point that the 
major efforts of vocational guidance bureaus have been expended; 
but even a hasty consideration will show that the guidance 
exercised is tardy. It should have been present when the school 
training of the individual became different from that of other 
individuals — when he began to specialize and train himself for 
his life work. It may be stated with assurance that in all cases 
this specialization should be well under way before the completion 
of the formal education of the pupil. 

These remarks suffice to make apparent the need for such 
educational guidance in the high school and coU^e, as shall 
precede and serve as a basis for the later vocational guidance. 

2 1 
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2 •'••.^ Educational Guidance 

V-.. 

The genel^'lnethod to determine the accuracy of guidance is the 

same, .whether the guidance be educational or vocational, and 

it is one of the chief aims of this study to determine accurately 

the -Friability of the estimation of academic capacity. The data 

n.ec6Bsary for accomplishing this are at hand, for high school 

records of academic accomplishment are universally kept. Com- 

'••parable vocational records are generally not available; but for 

.'*•. fhe determination of the reliability of an estimate of vocational 

./•*.'" fitness they are essential, and whenever available the method 

'*•/ here used is applicable. 

The two chief factors entering into the problem of efficient 
guidance are, first, a correct understanding of the demands of 
prospective tasks and, second, an accurate valuation of the ability 
of the person in question to meet these demands. These two 
main elements of the problem may be stated as requiring an 
analysis of the individual to determine his characteristics, and 
an analysis of the needs of the situation to see to what extent 
the individual meets these needs. This is a general statement 
of the problem applicable to all kinds of guidance. The problem 
here undertaken is termed one in educational guidance, since the 
data concern high school pupils and high school subjects; but 
the method, which is that of calculating the correlation between 
the estimate of a person's fitness for a task and his later perform- 
ance in it, is of general validity and importance and will inevitably 
be used extensively in vocational guidance. 

As success usually depends upon several factors, partial corre- 
lation and the regression equation method are essential in the 
evaluation of the data. This method will be explained more 
fully later. The writer is not aware that it has been used before 
in a guidance problem, but its peculiar adaptability to a problem 
of this nature insures its extended use in the future. 

More specifically, the endeavor of this study is to predict with 
a known, and as high as possible, degree of accuracy the capacity 
of the pupil to carry a prospective high school course. In doing 
this, an analysis of the factors which make for success in the 
course is obtained. The essential objects of the study are thus 

(1) a measurement of the characteristics of the pupil, together 
with the determination of the extent to which these character- 
istics correlate with scholastic ability along certain lines, and 

(2) an analysis of the demands of certain high school courses. 
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To illustrate the intimacy of these two problems it may be 
pointed out that if all the essentials of fitness needed to fulfill a 
certain task were known, and if the abilities of the person under 
consideration were completely known, then prediction and 
performance would agree perfectly; and to the extent that this 
condition is approximated, the correlation between prediction 
and performance is increased. 



SECTION 2.— METHOD AND SPECIFIC OBJECT 

When selective classification of a prospective high school 
pupil is attempted, the usual question asked is, what is his general 
mental ability, and he is classified according to the answer to 
that question. The present study attempts to .answer that 
question by considerations based upon one of three sources of 
data: (1) the pupil's grammar school record, (2) estimates of 
previous teachers of the^ pupil, and (3) grades obtained in special 
tests given the pupil at the very beginning of the school year. 
Beyond this, it is imperative, in rendering the most valid decision 
as to the pupil's capacities, that account be taken of his specific 
ihterests and peculiar genius. An excellent student of mathe- 
matics may be a very poor English scholar, and though this sit- 
uation is not true in the majority of cases, yet the number of 
cases in which it is true is sufficiently great that very material 
injustice will be worked if it is not taken into consideration. 

The further aim of this study is, therefore, to determine, before 
courses in the high school are taken, what the probable ability 
of the pupil in question will be in them. Instead of attempting 
to cover the field of high school work exhaustively, three subjects 
— mathematics, English and history — have been selected for 
study. The general method of procedure with all three subjects 
and all three sources of data is to separate the data into ele- 
ments that are, as far as possible, independent of each other, 
e.g., the teachers' estimates of the pupil are four in number, (1) 
intellectual ability, (2) conscientiousness, (3) emotional interest 
in his work, and (4) oral expression. All of these factors are 
important for scholastic work and it would be desirable if they 
were totally uncorrected with each other. The first and fourth 
and the second and third are rather closely related with each 
other, but even so there is sufficient independence between the 
four to make their combined significance as indicators of scho- 
lastic success considerably greater than that of a single estimate, 
such as that of intellectual ability. 

If the grades received, or marks given, in the original data are 
represented by Xi, X2, Xs, X4, and if the grades received in the 
high school mathematics, English and history courses six months 
4 



Method and Specific Object 5 

or a year after the original data are obtainable are represented 
by Xm, Xe, Xe, then the problem is to establish the correlation 
between Xm and the combined measures based upon Xi, Xiy Xt, 
Xi, and similarly with Xe and Xg. Expressed as an equation 
it is XM^^Co+CiXi+CiXi+CzXz+CiXi. This is equivalent to say- 
ing that a certain constant times the grade received in the first 
trait (or test), plus a second constant times the grade received in 
the second trait (or test), plus, etc., gives the probable grade in 
the course about to be taken. The statistical problem involved 
is the determination of the constants co, Ci, C2, Ct, C4, so that the 
Xm values obtained diflfer on the whole, and when every indivi- 
dual is taken into account, from the actual Xm values by the 
smallest amount possible.^ 

The equation which fulfills this condition is called a regression 
equation, and the constants ci, c^, cs, Ci, are called regression 
coefficients. They are functions of the coefficients of correlation 
between the various X's and the standard deviations of the X's. 
The theoretical proof of the derivation of these constants may 
be found in Yule, ** Introduction to the Theory of Statistics," 
and a considerable amount of the purely mathematical work 
involved in their calculation is given in the Appendix of the 
present work.' For an understanding of this investigation (ex- 
cept the Appendix) and the use of the method, it will suffice if the 
reader has well in mind the fact that the value Xm for each 
individual obtained by this equation is the most probable value 
which it is possible to obtain from the data Xi, Xs, Xs, X4*. 

This regression equation is the means of prognosis, and to use it 
in the case of any individual it is only necessary to substitute the 
values Xi, Xj, X$, X4, for that individual, to obtain a value Xjf . 

In addition to knowing the value Xm, it is essential to know 
the probable error of it, or to know its standard deviation. This 
has been calculated in all cases, that the reliability of the prog- 
nosis may be known. This reliability depends upon two factors, 
the reliabilities of Xi, Xs, Xs, X4, and the extent to which these 

^Or, more accurately, that the calculated Xj^'s differ from the actual 
Xm*b by such amounts that the sum of the squares of the differences is a 
minimum. 

'The writer is about to publish tabled which will greatly facilitate the 
calculation of regression equations. 

*For the mathematician the words "in case the regression is rectilinear'' 
may be added. 
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X'b are correlated with Xm (this latter is in part dependent upon 
the former). The reliability of any given measure Xi is given 
by the reliability coefficient/ which is simply the value of the 
coefficient of correlation between the given set of Xi's and a 
second set similarly derived. To obtain this measure it is neces- 
sary to have the Xi grades assigned by at least two judges, which 
procedure has been followed throughout except where impossible 
because of the nature of the data, or where totally unnecessary 
because the grading was so completely defined that the judge had 
little or no option left to him in his grading. The formula giving 

this reliability coefficient of a grade, which is the average or sum 

nr 

of the gradings of n judges, is 77"; tt" where r is the correla- 

* ^ ' l + (n — l)r 

tion between gradings of dififerent judges. Most of the tests in 

this study have been graded by two judges, so that the formula 

becomes 77" • 

1+r 

It is later explained at some length that the use of correlation 
coefficients, corrected for attenuation, is not permissible in this 
problem. The attempt here is to prophesy accomplishment by 
measuring an existing, not an imaginary, relationship, whereas, 
in the studies using methods for ''correcting" raw coefficients 
of correlation, the attempt is to obtain a coefficient which is an 
estimate of an ideal relationship and which does not represent a 
correlation between existent data. This distinction should be 
clearly borne in mind and comparison should not be made with 
studies using coefficients corrected for attenuation. 

In addition to being the means of prognosis, the regression 
equation serves one other important function: the regression 
coefficient ci gives the weight that must be attached to the 
measure Xi, independent of and free from any relation it may have 
with Xi, Xt, X4. It therefore makes it possible to consider the 
importance of each of the factors Xi, X2, Xz, X4, independent 
of the others. Such an analysis is essential in arriving at the 
separate factors which go to make up efficiency in any given sub- 
ject. This latter use of the coefficients of the regression equation 
will be more apparent when treating of teachers' estimates and 
the special tests, than in the following section covering the use 
of elementary school grades as indicators of high school ability. 

^ See Brown, Mental Measurement, pp. 101-102. 



SECTION 3.— SCHOOL GRADES AND THEIR SIGNIFI- 
CANCE AS EVIDENCE OF HIGH SCHOOL 

EFFICIENCY 

The data here treated consist of the scholastic records of 59 
pupils whose grades were available from the fourth grade through 
the first year of the high school. These pupils had attended the 
same school without a break, except for minor illness in certain 
cases, during this period. The grades of the pupils in the follow- 
ing subjects were copied from the high school records: Fa (first- 
year average grade), Fm (first-year mathematics-algebra), Fb 
(first-year English),^ 7a (7th grade average grade), 7m (7th grade 
mathematics-arithmetic), 7e (7th grade English), 7h (7th grade 
history), 6a, 6m, 6e, 6h, 5a, 5m, 5e, 5h, 4a, 4m, 4e, 4h.' 

The coefficients of reliability of these measures are not avail- 
able, but they are probably not less than .80 for Fa, 6a, 4a, and 
not less than .75 for 7a and 5a. It was first determined what 
connection there is between 7a, 6a, 5a, 4a, and Fa. In order to 
determine this the correlation between each one of these grades 
and all the rest is necessary. These correlations are given in 
the following table: 

5a 





Fa 


7a 


6a 


7a 


.719 






6a 


.728 


.730 




5a 


.531 


.425 


.541 


4a 


.624 


.551 


.573 



.576 

There are several surprising items in this table. All of the 
correlations involving 6a and 4a are higher than would be ex- 
pected from the balance of the data. It certainly would not be 
expected that 6th grade marks would correlate more highly with 
first year standing than 7th grade marks, nor that 4th grade 
marks would correlate more highly with first year and 7th grade 
marks than 5th grade marks. It is possible that the teachers of 
the 6th and 4th grades were more expert in estimating the ability 

^ See Appx., pp. 109-116. 
'See Appx., p. 116. 
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of their pupils than were the teachers in the 7th and 5th grades. 
However this may be, to get the most out of these particular 
data in their bearing upon Fa, the regression equation, based 
upon these coefficients of correlation and the various standard 
deviations, must be obtained. Calculation shows it to. be as 
follows :i C . Fa = 1.67 (7a) + 1.3 (6a) + .4 (5a) + .7 (4a). (In 
which C is some constant.) Calculation shows the correlation 
between the Fa's thus obtained, and the Fa's actually obtained 
in the first year to be .789, with a probable error of .032. This 
correlation will be designated by the symbol rpA(7,6.6.4A)- This 
is a high correlation for data so far apart in time, and the 
division of pupils in the high school into sections according to 
ability, upon the basis of this prognosis, would be much more 
accurate than that which would be possible after observing the 
progress of the pupil in the high school for half a school year; for 
this correlation is undoubtedly higher than that between average 
half-year term grades. Especially would this be true if succeed- 
ing term grades were given by different instructors. 

The argument that this correlation is not perfect and would 
work injustice in certain cases is utterly impotent if the alterna- 
tive is the present very common system of mixing the good, the 
medium and the poor all together, thus actually doing injury 
to all. For any high school having more than a single section 
of each class, and where grammar grade records are available, 
the desirability of classification upon the basis here worked out 
will be apparent, whether considered from the standpoint of the 
nervous strain upon the teachers of a non-homogeneous class, 
from the standpoint of economical administration, or from the 
standpoint of the accomplishment of the pupil. In this connec- 
tion it should be mentioned that the accuracy of a classification 
based upon the marks received in the 7th grade alone is not very 
materially less than that which is based upon the marks from the 
4th to the 7th grades, and would be of very decided value in 
case more extended records are not available. 

There is one drawback to the use of the above regression equa- 
tion, viz: by its use that pupil, who is particularly capable in 
some one line, is not classified more highly in that line than he is 
in others. A more detailed estimate of ability is desirable and 

1 See Appx., p. 91. 
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can be obtained by calculating the regression equations to esti- 
mate ability in the various subjects of the first-year class, instead 
of one regression equation to estimate average high school ability. 
The most probable grade in first-year mathematics (Fm) 
would be determined from the grades received in the dififerent 
elementary school subjects for the years for which the data are 
available, i.e., the most probable value of Fm is equal to some 
combination of 7m (7th grade mathematics), 6m, 5m, 4m, and also 
7e (7th grade English), 6e, 5e, 4e, and so forth for the balance 
of the elementary school curriculum. The grades in only three 
elementary school subjects, mathematics, English and history, 
were taken from the school records (it is the average of these 
three that give the grades 7a, 6a, 5a, 4a), since these subjects all 
run through the last four years of the elementary school, and 
since the means of the various grades for these subjects could be 
determined with considerable accuracy, probably very much 
greater accuracy than with such subjects as nature study, writing, 
music, etc. Furthermore, Fm is undoubtedly more especially 
dependent upon the grades 7m, 6m, 5m, 4m, than upon grades in 
other subjects in the curriculum, and similarly with Fe and 7b, 
etc. It may also be stated that for purposes of determining the 
difference of capacity of a pupil for mathematics and his capacity 
for English there is very little gained by involving a subject such 
as history in the calculation. For these reasons, the bearing of 
7m, 6m, 5m, 4m only upon Fm has been obtained, and in doing 
this it was assmned that the importance of the various years of 
the elementary school was the same as in the case of the average 
first year standing and the average standings of the elementary 
grades. The equation of relation (the term regression equation 
is reserved for equations satisfying entirely the conditions laid 
down for such equations) is therefore as follows: 

C • Fm = 1.67(7m) -hl.3(6M) -h.4(5M)-h.7(4M) 
Similarly C- FE = 1.67(7E)-hl.3(6E)-h.4(5E)-h.7(4E) 

The correlation between the Fm's thus obtained and the actual 
Fm's is .680 (fft, (7, 6. «. 411)). For English rp, (7. 6. 6. 4.) = -710. The 
greater correlation in the case of English than in the case of 
mathematics may be partly due to an intrinsic difference in the 
laws of development of an individual with reference to these two 
subjects, but it is, at least in part, due to the greater reliability 
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of the English elementary school marks, since these measures are 
an average of the grades given in two English courses, whereas 
the arithmetic grades are obtained from but a single course. It 
is evident that there is also a greater content difference in passing 
from arithmetic to algebra than in passing from 7th grade Ekiglish 
to first-year English. From a statistical point of view it does 
not seem likely that the difference in reliability cofild entirely 
account for the difference in correlation, and the author will 
state that the mathematical probability of the difference being 
due to chance is small, though he cannot express this probability 
in exact numerical terms. 

It has been stated that the value of these coefficients of corre- 

* 

lation lies in their power to differentiate between the ability of 
the pupil in mathematics and in English. The extent to which 
they perform this task in differential diagnosis can be measured 
by comparing for each individual the difference between the 
estimated ability in mathematics and the estimated ability in 
English with the actual difference of ability as shown by the 
grades in the two subjects. If individual (1) is estimated to be 
.7 sigma (standard deviation) above the average in mathematics 
and .4 sigma above the average in English, and the actual grades 
which he received are .9 sigma above the average in mathematics 
and .6 sigma above the average in English, then the estimated 
difference between the abilities in the two subjects is equal to the 
actual difference. 

The extent to which differences in estimation correspond to 
differences in first-year grades is given by the coefficient of 
correlation between these two differences, r^^,-!) (7. 6. 6, 4, »-■)• It 
is evident that if this correlation equals zero, then English 
grades in the elementary school are as good a basis for estimation 
of mathematics grades in the first-year class of the high school 
as are mathematics grades in the elementary school — in other 
words, intelligence is general, and may be directed by the in- 
dividual with equal result in any direction. On the other hand, 
if the correlation is perfect,^ then mental capacity is specific and 
specialized to exactly the same extent and in the same manner 

^For this theoretical consideration, not in the nature of a prognosis, a 
coefficient of correlation corrected for attenuation might be desired, but the 
data for its calculation are not available, nor is it likely that the assumptions 
underlying its derivation (lack of correlation of errors^ etc.) would be sound. 
Such ooireotion, if utilised, would increase the correlation found. 
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in the high school and in the elementary school when dealing with 
the same subjects. Calculation shows that r^rii-i) (7. s. 5, 4, m-i) ^ -SIS* 

The net conclusion which may be drawn from these four 
coefficients of correlation is, that it is possible to estimate a 
person's general ability in the first year class from the marks he 
has received in the last four years of the elementary school with 
an accuracy represented by a coefficient of correlation of .789; 
and that individual idiosyncracies may be estimated, in the case 
of mathematics and English, with an accuracy represented by a 
coefficient of correlation of .515. 

The method of doing this is the simple one of substitution in 
a regression equation. The regression equation given above 
proved the best for the school from which the data are obtained, 
but it probably would not occur in the usual school that the 
correlations of the 6th and 4th grades would be relatively as high 
as in this particular school. Assuming that for the usual school 
there is a progressive gain in correlation with first-year standing 
as one proceeds from the 4th to the 7th grade, we would have 
correlations about as follows:^ 

4a 





Fa 


7a 


6a 


5a 


7a 


.67 








6a 


.68 


.67 






5a 


.53 


.58 


.67 




4a 


.50 


.53 


.58 


.67 


OS 


ffFi 


»:* 


ff«4 


ffj4 



The regression equation based upon this table is as follows: 
Fa = .4616 ^ (7a) + .1458 ^ (6a) + .0910 ^ (5a) 

'7A »«4 "u 



+ .1094-?i(4A) (a) 



»4A 



In "case the v'b are all equal this equation becomes, to a very 
close approximation, 

64.9(Fa) = 25(7a) + 8(6a) + 5(5a) + 6(4a) (b) 

Equation (a) is the equation recommended for use in the ordi- 



i See Appz., n>. 91-92. 
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nary school system. The elementary student of statistics can 
use this equation without dif&culty. First calculate the standard 

deviations, <^Ya.> <^7k> ^«4> ^Uy *'"4a> then express (.4616—) as a 



single number, and do similarly with ( .1458 — ), etc. This will 



(.H5S^.), 



result in an equation of the type (b) except that the coefficient 
of Fa is unity. It then only remains to substitute the values 
7a (the average grade expressed as a deviation from the mean), 
6a, 5a, etc., for each individual considered, to obtain the probable 
grade, expressed as a deviation from the mean, of the individual 
in his high school work. A similar procedure may be followed 
for each high school subject, substituting for 7a, 6a, 5a, 4a, the 
corresponding 7th, 6th, 5th, and 4th grade marks in the subject 
in question. The result thus obtained will give the relative dis- 
tribution of the pupils, but in this latter case the most probable 
mark for the first-year grade may be expected to be numerically 
a little smaller than the grade given by substitution in the equa- 
tion. 

This amounts to saying that the weighting of the grades of the . 
various years of the elementary school is probably the same 
whether one deals with average grades or with grades of certain 
subjects, but that the correlation foxmd is probably smaller in 
the latter case than in the former. The essential problem is to 
divide the pupils into groups according to ability, and this the 
values obtained by substitution in the equation will do with 
considerable accuracy. The exact degree of accuracy can be de- 
termined at the end of the school year by calculating the coeffi- 
cient of correlation between the prophesied grade and the grade 
actually obtained by the pupil, due allowance being made for 
difference in the rigidity of grading in the various sections of the 
same course — such differences undoubtedly being present if the 
sections have been divided upon the basis of ability. 

At first glance the fact that in the equation (b) the record in 
the 4th grade is weighted more heavily than the record obtained 
in the 5th grade is surprising. This arises from the fact that the 
4th grade record has a greater independence than the 5th and 6th 
grade records, and therefore contributes more of an independent 
nature upon which to estimate freshman standing. This is to 
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say that from the 4thy 6th and 7th grade records a closer estimate 
of the 5th grade record can be obtained than can be obtained of 
the 4th grade record from the 5th, 6th and 7th grade records. The 
relatively greater independence of the first and last terms of the 
series is to be expected, and is a cause of their greater weighting. 
Before leaving this subject, it is interesting to note that the 
correlation between the average first-year standing and the 
average marks for the 4th grade is .624. This high correlation, 
together with the fact that those who skipped grades were graded 
high by giving them the grades of the preceding year,^ instead of 
being graded low by giving them the grade of the following year, 
on the ground that having missed a year they would be handi- 
capped in all their succeeding work, is strong evidence that 
natural capacity is a very much more important factor than 
training in determining relative scholastic standing. Indeed, it 
seems that an estimate of a pupil's ability to carry high school 
work when the pupil is in the 4th grade may be nearly as accurate 
as a judgment given when the pupil is in the 7th grade, for the cor- 
relation in the former case is .62 and in the latter only .10 higher. 

^ See Appx., p. 89. 



SECTION 4.— TEACHERS' ESTIMATES AND THEIR 

SIGNIFICANCE 

Toward the close of the first half year the teachers in School A 
were given lists of pupils in groups 1^ 2^ and 3 and asked to grade 
the pupils according to intellectual ability (I. a.) on each list 
1, 2, 3, etc., as far as valid judgments could be made,,^Then, 
beginning with the weakest, pupils were to be graded a, b, c, etc., 
as far as judgments could be made. Finally, the remainder of 
the pupils known to the teacher were to be marked M, signifying 
a medium group. The demand that ranking be from the best 
to the poorest, without a medium group, would probably have 
resulted in less accurate judgments throughout the entire series, 
for it would have been beyond the power of the majority of teach- 
ers to have made valid distinction throughout this range. As it 
was, on the average, about 25 per cent were placed in the medium 
group. These rankings were then expressed as deviations from a 
mean and the results of the gradings by the various teachers 
combined for each pupil into a single measure.^ 

The same procedure was followed for the traits conscientious- 
ness (Cons.), emotional interest in school work (Emo. i.), and oral 
expression (Exp.). 

These estimates were obtained before the time of the English 
and history courses used in this study and before the second half 
year of the mathematics courses used. None of the estimates 
used were from the mathematics instructors of the pupils. A 
further effort was made to eliminate the possibility of the esti- 
mates of the teachers being more highly correlated than a chance 
selection of teachers' estimates would yield, by excluding the 
estimates of English and history teachers who later had the same 
pupils, in courses here utilized, that they had already taught in 
the first half year's work. This was possible in all the 460 cases, 
except in the case of 23 estimates which it was necessary to use 
in order to secure sufficient data.> The teachers' estimates are 

^ See Appx., pp. 92-93. 
' See Appx. p. 93. 
14 
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therefore practically free from any direct bearing upon mathe- 
matics, English and history, but there is a certain amount of 
direct connnection with average class standing. For example, 
the estimate of a teacher of Latin, made near the close of the first 
half year of school, enters into the teachers' estimate grade, and 
the grade given by this same teacher for the yearly grade in Latin 
of the pupil enters into the average grade for the year. This lack 
of entire independence operates to slightly raise the correlation 
between teachers' estimates and average class standing. From 
the data at hand this increase is estimated to be less than .03. 

The-xorrelation between gradings by different teachers of the 
same pupil for the same trait are as follows: 

'*(I.a. Moordfaigto one teMher'sMtiinite) ~ ^^ 
"ftwoond 

''(CoDt. Moording to one toMher't Mtumte) ^ ^^^ 

'*(Smo. i. Moording to one teaeher't eitimate) ^^ »^^ 

^(Exp. MOording to one teMher'i Mtiinito) ^ '^ 
" ftieooiid 

On an average there were about two and one-half estimates per 
pupil, so that the reliability coefficients of the various gradings 
are: 

Reliability coefficient of La. grading '='.493 

" Cons. '* =.606 
" Emo. i. " =.505 
" Exp. " =.529 

The conditions laid down for securing teachers' estimates were 
simple to use, but at the same time allowed for as detailed judg- 
ment as possible. When first-class teachers can estimate intel- 
lectual ability with a reliability of only .29 it lessens the confidence 
that can be placed in such estimates of ability and conclusions 
drawn from studies depending upon them. 

Teachers' estimates of pupils have the unique value of indi- 
cating, more or less accurately, single mental traits instead of a 
complex of traits such as are involved in the securing of a grade 
in a subject, but it is highly desirable that these estimates be 
made by several competent individuals, otherwise the measures 
are very unreliable. 
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The correlations between the vaxious estimates and the 
average grade (Av.) of each 

pupil are given in the ac- a t /-• t? • 

^ ^ . X 1-1 mi- Av. I. a. Cons. Emci. 

companying table. The re- 
gression equation based ** 
upon this table is: Cons. .62 .61 

A o T t A /^ Emo. i. .58 .61 .66 

c • Av. =8 I. a., +4 Cons., 

+2Emo. i., ^^P- -^^ '^^ -^^ -^^ 

+lExp.i 

The correlation between average class standing and the regres- 
sion equation combination of the estimates of traits 

''Av. (I. ft., Com., Emo. I., Exp.), = • • ^' 

With such a high correlation, a division of pupils into classes 
by means of teachers' estimates would be highly reliable. The 
use of the equation to estimate probable class standing for a 
school system with a different system of marking from that of 
the schools here considered follows the same general lines as in 
the case of elementary school grades. (See Appendix.) 

In so far as all high school subjects are equally dependent upon 
the traits, intellectual ability, conscientiousness, interest and 
expression, classification according to grading in them is not 
selective. The extent to which these factors have a common 
importance for different subjects can be measured by calculating 
the regression equations involving class standing in different 
subjects and the teachers' estimates. The following equations 
give the regression of mathematics, English,* and history, respect- 
ively, upon I. a.. Cons., Emo. i. and Exp. For simplicity, all 
standard deviations are assumed equal. M(.e. stands for the most 
probable mathematics grading, based upon teachers' estimates. 
Et.e. and Ht.e. have similar meanings. 

Mt.e. = .460I.a.+.114 Cons. + .129 Emo. i. - .014 Exp. 

Et.e. =.336I.a.+.251 Cons.+.068 Emo. i.+. 083 Exp. 

rEB,.e=.64 

Ht. e. = .450 1, a. - .024 Cons. + 305 Emo. i. - .287 Exp. 
rHHt... = .46 

* See Appx., p. M. 
' See Appx., pp, 94-95. 
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The negative significance of expression in the case of mathe- 
matics and history is probably entirely due to the lack of inde- 
pendence of the estimates of oral expression. This is the most 
objective of the four traits and for that reason it might be con- 
sidered the easiest to estimate. This view seems incorrect, for 
oral expression is probably a trait which teachers do not think 
much about and which they make little attempt to measure, with 
the result that, when called upon to give an estimate of it, they 
rely upon associated characteristics, such as intellectual ability, 
conscientiousness and interest, traits already evaluated in their 
minds. The result of such a procedure is to obtain measures of 
expression which are correlated to an unwarrantable degree with 
more fundamental traits. The tendency to rely upon secondary 
criteria in the estimation of mental traits is a very difficult one to 
overcome and the intercorrelations between the four traits esti- 
mated are probably all higher than would be shown to be the case 
with more accurate measurement of them. 

The effect of unwarrantably large intercorrelations upon the 
regression equation is to tend to give the factor which is the 
dependent one, e. g., in this case expression, small or negative 
weighting. The weighting which the regression equation gives 
is the best available for the measure, but the measure is probably 
not at all an accurate one of the trait considered. A reference 
to the table on page 16 shows surprisingly high correlations be- 
tween expression and the other traits. This is itself an indication 
that the measures called ''oral expression" are dependent com- 
plexes of other more fundamental traits. 

The equations show a decided variation in importance of the 
different traits with reference to different subjects. Intellectual 
ability is most important in its bearing upon mathematics and 
least important in its bearing upon English. Conscientiousness 
is most important in its bearing upon English and least in its 
bearing upon history. Interest is most important in its bearing 
upon history and least upon English. Expression is the most 
important in its bearing upon English and least in its bearing 
upon history. 

The striking importance of interest for history work, of con- 
scientiousness for English, and of native capacity for mathe- 
matics are points which can be utilized by the teacher giving the 

3 
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instruction as well as by the person attempting to diagnose 
differentially the pupil's capacities. 

Such estimates of teachers are not proposed as a good basis for 
the determination of the idiosyncracies of pupils, although it is 
possible in a small way to say what study a pupil will be most 
efficient in, simply upon the basis of teachers' estimates of gen- 
eral capacities. The correlation between the differences in math- 
ematics and English grades and the differences in estimate of the 
same is as follows: 

r(M-?)(Mt. e.-Bt. e.) "= • ^ ^ ^ (Probable error = .05) 

It is therefore apparent that the practical value of such teach- 
ers' estimates as are here used lies, in the main, in their power 
to measure general ability, rather than in a power to indicate 
points of individual strength or weakness. They probably would 
perform much the same function in connection with vocational 
guidance. 



1 Taking into account differences in standard deviations, e,g,, by reducing 
an standard deviations to unity. 



SECTION 5.— SPECIAL TESTS AND THEIR 

SIGNIFICANCE 

The data here concern the same groups of pupils as in the pre- 
ceding sections dealing with teachers' estimates. Three kinds 
of tests were given to determine ability, interest and preparation. 
We may say that three main factors enter into the production of 
a grade: (1) the mental capacity of the individual, (2) the prepa- 
ration of the individual for the particular course, and (3) the 
effort and interest of the individual in the particular subject. 
The importance of these three factors differs materially for differ- 
ent subjects, e. g., it requires a previous preparation in algebra 
and analytical geometry in order to carry calculus, and it would 
be a very peculiar genius who could read Virgil without previous 
Latin study. In these courses the factor of preparation is of 
prime importance. Courses in English, history, the sciences, 
commercial branches and the like, do not so definitely demand 
a certain accumulated store of knowledge as a foundation. The 
relative importance of these three factors is worthy of extended 
study and the data here given throw but little light upon the 
question. In drawing up tests these three factors were con- 
sidered with rather special emphasis upon the first and third. 
The high school subjects covered are algebra, geometry, English, 
and History, and a description of the various tests will reveal 
the parts devised to measure each one of these factors. 

(At) Algbbba Test 

The following test (called an algebra test simply because it was 
given to classes just starting in algebra) was devised for the pur- 
pose of measuring the ability and preparation of the pupil for 
algebra. Following each problem are given directions for grading 
it. 

Administration of the test: The only precaution that need be 
indicated in administering the test is that the teacher refrain 
from explaining any of the questions verbally. Question 5, in 
particular, loses its value if the slightest explanation is made. 

19 
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Algebra Test and Directions for Grading 
For all problems : maximum grade 10, minimum grade 

Name Date 



1. Add: 132 2. Multiply: 
580 42976 
649 30851 
356 

774 
263 
925 
191 
417 
828 

From 10 deduct 4 for each error in addition, or in canying forward. 
From 10 deduct 4 for each mistake in placing partial products, 2 for each 
mistake in partial product, and 2 for each mistake in addition. 

3. Divide 457219 by 638 and carry answer to one decimal place. 

From 10 deduct 2 for each failure to draw down, 3 for a mistake in decimal 
point, 2 for each error] in subtraction, and 2 for feulure to carry work to one 
decimal place. 

4. Simplify: 6J-3i-liJ+2i-U. 

From 10 deduct 2 for each mistake in simplifying a term, 3 for each error 
in addition. 

Give a grade of 5 for answer^ — 7""z; + 7~7- 

5 4 40 4 4 

5. Is the square constructed on a line (3+5) eight inches long greater than, 
equal to, or less than^ the sum of the squares oons&cted on lines 3 inches and 6 
inches long? Explam. 

If explanation shows an understanding of the problem grade it 10. Qm 
grade of 2 for (8X8) -(5X3) =49. 

6. What is that number such that if it is multiplied by itself and added to 
11 the result is 27? 

Give grade of 2 for answer KL 1 

7. A certain balloon without its basket will just lift a weight of 160 pounds. 
What is the weight of the balloon and basket if the basket weighs 20 poundB? 

Grade 10 for answer — 140, or for statement '' 140 pounds less than nothing^" 
or similar statement. Grade all other answers 0. 

8. Simplify: Xxix| + X. 

From 10 deduct 6 for incorrect inversion, or failure to make correct inver * 
Bion, 4 for each error in cancelling, and 4 for each other error. 

3_3 

9. Simplify: |— |. 

3-^8 
Give credit of 3 for correct simplification of numerator, 3 for denominator, 
and 4 for the balance. 



10. Simplify: 



Same as 9. 
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. 3^12 



9 2 



11. Find lowest common multiple and highest common factor of 42, 56, 63, 
84. 

Give credit of 2 for all factoring correct, 4 for H. C. F. if plainly labelled 
and 4 for L. C. M. 

12. January 1 of a certain year the temperature was 70 degrees, January 2 
it was 40 degrees. What was the temperature January 3 if it was still colder 
and the difference between the temperatures of January 3 and January 1 was 
three times as great as the difference between the temperatures of January 2 
and January 1? 

Give credit of 2 for answers of 90'', or 20''. 

13. Find a number such that if 5 is added to 3 times that number the result 
18 38. 

Grade 10 or 0. 

14. One-third of a certain number added to 7 is equal to 22. What is the 
number? 

Give credit of 2 for answer of 5. 

The primary purpose of problems 1, 2, 3, 4, 8, 9, 10, 11 is to 
test the thoroughness of the preceding preparation of the pupil. 
The remaining questions are primarily for the purpose of testing 
his capacity to deal with algebraic material; questions 5, 6, and 
12 testing his ability to understand the written statement of a 
problem and to deal with negative magnitudes, and questions 6, 
13, 14 demanding elementary algebra, or at least a process of 
thinking which is very closely related to simple algebraic reason- 
ing. Problem 7 may be objected to on the ground that the stu- 
dent of physics, who has weighed gases and the like, may be 
misled by the term ''weight" when a negative magnitude is 
demanded for a correct solution of the problem. None of the 
subjects showed that this particular difficulty was present in their 
minds, probably because none of them were familiar with the 
necessary physics. 

The grading is highly objective and the reliability accordingly 
very high. To calculate the reliability, a sample was graded by 
two judges. The correlation between the total grades for each 
pupil as determined by the two judges, is .996, which is the 
reliability coefficient, as most of the papers were graded by a 
single judge. The various problems in this test are approxi- 
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mately ^ of equal significance and the sum of the grades of all of 
the problems is the grade for the test. To obtain a distribution 
which would be convenient for purposes of calculation from the 
grade thus obtained, the average grade of the group in question 
was subtracted and the remainder divided by 5, keeping the result 
to the nearest integer. This grade is designated by At (algebra 
test) and when grouped with the grades of the geometry test by 
Mt (mathematics test). 

(Gt) Geometry Test 

Administration of test: In giving the following test, problems 
1 and 2 require explanation. A demonstration is given the 
pupils of a simpler problem, to show the nature of the requirement. 

Paper, about one foot square, is held against the black- 
board with the top edge horizontal, folded once from the 
bottom up, a second time from the right to the left and, while 
still close to the blackboard and without rotating the paper, 
a V-6haped notch cut into it. The pupils 
are then asked to describe, orally, the ap-' 
pearance of the paper when unfolded and 
after receiving a few correct answers the 
paper, still against the blackboard, is un- 
folded, enabling the entire class to see that 
the unfolded paper does have the shape 

The test question is then given, folding the 
paper along a diagonal, giving it this appearance 
a second fold leaves 
it in this shape 
a third 
in this 






and after notching it appears thus 

The pupils are then asked to represent its appearance when 

unfolded. 

The nature of the requirement in the second question can be 
made clear by means of two large wooden compasses, each hand 
holding points of the different compasses, and demonstrating the 



* See Appx., pp. 96-96. 
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lack of rigidity of the diamond-shaped frame thus formed. 
Care should be taken not to indicate the position, or number, 
of braces necessary to make the figure rigid. 



Name 



Geometry Test and Directions for Grading 
All problems : Maximum grade 10, Tninimnm grade 

Date 



1. The accompanying^ diagram represents a square 
sheet of paper which is folded three times by tibe 
teacher and cut. Draw in the square, in their correct 
position, the holes cut out. 



Credit given for drawings as follows: 



2. Suppose that AB, BC, CD and DA 
are sticloB of wood hinged together at 
points A, Bf C and D. How many braces 
are needed to make the figure rigid and 
where would you put the brace or braces? 

For one brace properlv placed give credit 
of 10, improi>erly placed credit of 4. For 
two braces give credit of 2. 

3. John's mother forbids him to leave 
Broadway. James' mother forbids him to 
leave Amsterdam avenue. They are obe- 
dient sons, but are also very fond of seeing 
each other, so how can they meet? 

Give credit 10 for answer 72nd St. Any 
other answer 0. 





4. AB is a railroad track. C is a stake 
to which a cow is tied with a 30 ft. rope. 
DE measures a distance of thirty feet. 
One day the cow^ while grazing at the 
end of its rope, is struck by the train. 
Mark the place or places in the diagram 
at which this must have occurred 

Give credit 10 for indicating two poin£s 
correctly, 6 one point, 6 for distance be- 
tween the two correct points. 



^ 30ft. _ 



C 
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5. In the accompanying figure, 
the distance along the circle from 
B to C equals the distance along 
the circle from AtoB. Also, the 
straight line BC equals the strai^t 
line AB, Does the curved Ime 
from A to C equal twice the curved 

line from A to B? 

Does the straight line AC equal 
twice the straight line AB7 



Give credit 10 for both answers 
correct, 2 for one correct. 




6. What are the areas of figures A^ B, and C? A. . 
In what respect, if any, are figiu-es A and B alike? 
In what respect, if any, are figtu-es B and C alike? 
In what respect, if any, are figures A and C alike? 



.B 






Give credit: 

Ifor A=9. B-=4, C»4. 
3 A and B both squares. 

2 A and B alike in shape. 

3 B and C equal in area. 

1 B and C both parallelograms. 
3 A and C both rectangles. 
2 A and C not at all alike. 



7. Find the value of x from the equation f ~ ^. 

a 

Find value of y from the equation - ~ 3. 

y » 
Give credit: 

4 for X - ^. 
a 

6 for V - S^. 
c 

Anything else 0. 

In the following question, is the third statement proved if the first two are 
true? Write " proved " or " not proved " after it. 

8. 1. Every chalet is a bungalow. 

2. Jones' house is a bungalow. 

3. Th^^ore Jones' house is a chalet 

Credit 10 or 0. 

Do the same for the following question: 
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9. 1. Every chalet is a bungalow and every building that is not a bungalow 

is not a chalet. 

2. Smith's house is a bungalow. 

3. Therefore Smith's house is a chalet 

Credit 10 or 0. 

Do the same for the following question : 

10. 1. Every building that is not a chalet is not a bungalow. 

2. Brown's house is in no particular different from a bungalow. 

3. Therefore Brown's house is a chalet. 

CreditlOorO 

The primary purpose of all the problems, except problem 7, is 
to test capacity; problem 1 testing ability to image geometrical 
forms and movement. Problems 2, 3, 4, 5, 6, are locus problems, 
and problems demanding a common sense interpretation of 
geometric facts. Problem 7 is a problem to test the pupil's 
previous preparation in the line of ratio and proportion. Prob- 
lems 8y 9 and 10 are problems in logic aimed to test the pupil's 
ability to handle reductio ad absurdum proofs and converse 
propositions. Problem 10 is a difficult problem and is meant to 
tax the most able pupil. It may be said that all the tests were 
devised with a view to securing a good distribution of marks. 
It was desired that the most efficient pupil would just succeed, 
or just not succeed, in making a perfect score, while at the same 
time the tests were meant to be sufficiently easy in places to secure 
the cooperation of the poorest pupil. The reliability coefficient 
for this test is very high, being .994. A number of the problems 
in this test did not prove as significant as conferences with various 
teachers of geometry led the author to expect,^ and the grade 
for the entire test is taken as the sum of the marks for problems 
1, 7, 8, 9, 10. To obtain a convenient distribution for purposes 
of calculation, from the grade thus obtained the average of the 
group in question was subtracted, and the remainder divided by 
3, keeping the answer to the nearest integer. This grade is 
designated by Gt, or Mt when grouped with algebra data. 

(Et) English Test 

The English test which follows, together with the explanation 
of the grading and the sample grading, will explain the purpose 
for which it was devised. It is fundamentally an ability test 
and seems to meet the requirements very well, as none of the 

* See Appx., p. 97, 
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pupils gave evidence of familiarity with the subject matter of the 
test. 

Administration of the test: Tell the pupils that you are about to 
read an account of an incident in the life of the founder of one of 
the great Eastern reli^ons and that after reading you are going 
to ask them questions about it. Then read the following:^ 

English Test 

** A woman — dove-eyed, young, with tearful £aoe 

And lifted hands — saluted, bending low: 

"Lc»dl thou art he," she said, "who yesterday 

Had piW on me in the fig-grove here. 

Where I lived lone and retured my child: but he 

Straying amid the blossoms found a snake^ 

Which twined about his wrist, whilst he did laugji 

And tease the quick foiiced tongue and open mouth 

Of that cold playmate. But. alas I ere lon^ 

He turned so pale and stiU, I could not thmk 

Whv he should cease to play, and let my breast 

Fall from his lips. And one said, ' He is sick 

Of poison* ; anci another, ' He will die.' 

But I, who could not lose my precious boy. 

Prayed of them physic, wmcn might bring the light 

Bade to his eyes; it was so very small 

That kiss-mark of the serpent, and I think 

It could not hate him, gracious as he was. 

Nor hurt him in his sport. And some cme said, 

'There is a holy man upon the hill — 

Lol now he passeth in the yellow robe — 

Ask of the Rishi if there be a cure 

For that which ails thy son.' Whereon I came 

Trembling to thee, whose brow is like a god's. 

And wept and drew the face cloth from my oabe, 

Praying thee tell what simples might be good. 

And thou, great sir I didst spurn me not, but gase 

With gentle eyes and touch with patient hand; 

Then draw the face-cloth back, sayins to me, 

'Yea I little sister, there is that might heal 

Thee first, and him, if thou oouldst fetch the thing; 

For they who seek physicians bring to them 

What is ordained. Therefore, I pray thee, find 

Black mustfuxi-seed, a tola; only mark 

Thou take it not from any hand or house 

Where father, mother, cmld, or slave hath died; 

It shall be well if thou canst find such seed.' 

Thus didst thou speak, my Lord I" 

The Master smiled 
Exceeding tenderly. " Yeal I spake thus, 
Dear Kisagdtamif But didst thou find 
The seed?'*^ 

''I went. Lord, clasping to my breast 
The babe, grown colaer, asking at each hut — 
Here in the jungle and towards the town — 
'I pray you, give me mustuxi, of your grace, 
A tola— -black : ' and each who had it gave. 



^ Taken verbatim from Edwin Arnold, Light of Asia, p. 124r-8. 



^ 
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For all the poor are piteous to the poor; 

But when 1 asked, ^In my friend's household here 

Hath any peradventure ever died — 

Husband or wife, or child, or slave?' they said: 

'O Sister! what is this you ask? the dead 

Are very many, and the living few!' 

So with sad thanks I gave the mustard back. 

And prayed of others; but the others said, 

' Here is the seed, but we have lost our slave 1' 

'Here is the seed, but oiur good man is deadl' 

' Here is some seed, but he that sowed it died 

Between the rain-time and Uie harvesting I' 

Ah, sir! I could not find a single house 

Where there was mustard seed and none had died! 

Therefore I left my child — ^who would not suck 

Nor smile — beneath the wild-vines by the stream, 

To seek thy face and kiss thy feet^ and pray 

Where I might find this seed and nnd no death, 

If now, indeed, my baby be not dead. 

As I do fear, and as they said to me." 

** My sister! thou hast found." the Master said, 
''Searching for what none finds — that bitter balm 
I had to give thee. He thou lovedst slept 
Dead on thy bosom yesterday: to-day 
Thou know'st the whole wide world weeps with thy woe : 
The grief which all hearts share grows less for one. 
Lol I would pour my blood if I could stay 
Thy tears and win the secret of that curse 
Which makes sweet love our anguish, and which drives 
O'er flowers and pastures to the sacrifice — 
As these dumb beasts are driven — ^men their lords. 
I seek that secret: bury thou thy child!" 

The questions to the pupils are as follows: 

(1) State one or two thmgs about the story which you particularly liked. 
(6 minutes.) 

(2) Write an account of the story as fully as you can remember it. (9 
minutes.) (5 minutes for reading the passage, giving a total time of 20 
minutes.) 

The grading was upon the following four points, though the grading upon 
£t, Eft and Ew only, are used in obtaining a single measure of the Kngliah 
test: 

Et Valuation of the essential ideas in the poem. (Grade ai^iroximately 

from to 10, with an avera^ of 5. Further explanation follows.) 
Eft Accxu*acy and extent of description. (Start with 4 and to this add } 

for each point correctly made and subtract 1 for each point incorrectly 

made.) 
Ew Written expression. (Grade from to 10, with an average of 5. Give 

some slight weight to spelling.) 
Ed Dramatization. (Grade from to 10, with an average of 5.) 

The reliability coefficient of the English test, T^ — ^ 

or Ef, equals .969, since the grades used are the sum of the grades 
of two judges and the correlation, based on a sample of 36, 
between the grades given by the judges is .940. 
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The gradinff for valuation of the essential ideas of the poem was largely 
based upon tne answer to question (1). It followed closely the following 
scheme: 

Grade below: given for selecting the following as the point liked the best: 

lOdbl Love shown in the Master's way of teaching that sufifering is uni- 
versal. 

8 dbl "The grief which all hearts share grows less for one/' 

8 db2 Appreciation of poetry and language used. 

6 dbl Master's statement to the mother that the whole world suffers, or the 
idea that suffering is universal. 

6 dbl Master's statement, ''I would pour my blood if I could stay thy 
tears." 

4} dbl "The poor are piteous to the poor." 

4 dbl Mother'B tenderness and love for her child, or the mother's cry that 
she cannot lose her child. 

3 dbl Methods trust in the Master, and her courage. 

1 dbl Honesty and strength of mother in not taking forbidden seed. 

The plus or minus after each grade indicates the amount that quite gen- 
erally is to be added or subtracted, depending upon the answer to tne second 
question, as follows: 

Add 1 for genuine appreciation of the Master's character, i. e., his gentle- 
ness, compassion, humanity, and for genuine appreciation of the 
first three points above. 

AddO for correct narrative. 

Add— 1 for demonstrated lack of correct appreciation and for incorrect nar- 
rative which betrays incorrect appreciation of the Master's char- 
acter and motive. 

Having grades for accuracy (£•), valuation (Er) and written expression 

(W) ( W— "Z t or the average of the grades for written expression 

for the English and history tests / the single grade for the entire test is the 
average of these three grades minus the mean for greater convenience after 
multiplication by two, i. e., Et^KEa+Er+W— mean).* 

In the following samples, given to illustrate the method of 
grading, the points for which credit in accuracy has been given 
are underscored once and the incorrect points, for which credit 
was deducted, have been underscored twice. The grading for 
dramatization is not used in the final score for the test, but is 
given as it may have some interest in itself and probably has a 
specific significance in some other bearing than upon English. 

* See Appx., p. 08. 




special Tetis and Their Significance 



Name (PupU No. 187). 



I. I like the story of the poem T«ry much. I think it 
is very pathetic and hu a good point — I refer to the 
mothen grief being leasened becsuae ihe knew all othera 
hod to suffer. I also like the way the author wrote the 
poem. It is well told, and in beautiful language. 

U. The mother throws heraelf at the feet of the 
niaater and says that she come to him to now becauM 
yeeterday he was so kind to her and when on the 
deeert her child was pia y ini; with a snake and it bit 
him, and she feared for his life, she went to hiro and ssked 
consul of him. He said that she should net mustard seed 
from somebody, but beware not to take it from anyone 



n whose house there has been a death. 

"Yes," says the msst«r, " and did you net the mustard 
«eed? " 

"I went into every but," says she, and 
asked for the mustard seed and the good pet^Ie 
all gave it to me, for the pow pve to the 



poor, but when I asked if there had been a datth 



in the houae, they all answered, yes. So now I have 

to you, dear master, to once more seek consul, ere 

my baby diee, if he be not dead already. " 

The consul speaks, " Yesterday when you came to 

I, and asked my aid, your babe wm already dead, 



but I let you go and try to get the mustard seed, ao 



Et-|{E,+ET+W- 
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WMDe CPupUNo. 188) . 



I. I think that the lord wm very good and Uada 
in telling the mother to find something that wu not, 
and telling her that that thing would cure the baby. 
In that way she did not get a Bhock. 

I think the mother did right by not giving the baby 
the wrong seed, when ahe could not find the ri^t seed 
and then going t« the Icrd again for adrioe. 

II. When the story opene; a young mother ia 
bending low to a lord erf her religeon and t«lla the fol- 
lowing atory: " Yeeterday while my chiU waa playing 
in the narden and finHing a enake began to play with it. 
The make bit it leaving a gmall mark on the child'a 
skin and some nei^ibors said that the baby yt 



otherB that it was not dead yet but wft8 dying of poiaon. 
And othere advieed me to go to a certain lord who 
lived over the hill and to aak him what to do to the 
baby to aave him and then they toki me that the man 
in a yellow robe who waa walking on the road by the 
boiue was the lord ao I ran up to him and knelt down 
to aahite him and then I toc^ the face oover off hia face 
and showed the lord the maik and the lord felt the baby 
and told me to go and get aome black muatard aeed 
bat it muBt not eonu from a house wherein a father. 
pw^thfTt ffhJH Off 
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Special Testt and Their Significance 



Nmm (Pupil No. 200). 



I. It Kemfl to me that one ot the fineM pmota in 
thii passage, is the t«DdemesB that runs all through it. 
It is in the mother's epeach vben she talks of her 
child, and also in the answer, — full of pity and truth. 
Another thing about it is the wording, for the passage, 
although written in prose, sounds almost like poetry 
or music, on aooount of the beautiful words used. 

II. A woman, with tcaia in her eyes, came and 
threw herself at the feet of the Master. She told 
him of her child, who, while playing in the garden 
had been rtung by a serpent. In a short time he 
grew pale and cold, and people said he would su rely 
die. But the mother, unwilling to give up hope, had 
gone to the Master, certain that he, in his wisdom, 
could aid her, and reetore her boy to health. And 
the Master, full of compasMon, had told her to go 
with her child, from house to house, and beg for 
mustard seed, but from any house when man or 
woman, slave or child had died, she should not accept 
the seed, but go elsewhere. Carrying her child the 
mother had begged at eveiy door, but, although 
^dad to give her seed, in every house someorie had 
died, so the 
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L TW ««7 ■ «arwMl7 UKK&nt- Tlgpitlf rf 
tbt tbt "iaJ n>wfni f>«>r'' k nciat titkI, md d* iinle 
"(aot »> v^. *wj »(in" •»» slmcat b« warn. Wc ; 

loT^ torn •iortj'. TIk t^y wmiM daily ■fatpcBWMMC 
irjgnt». ftB^ii^jr, tliKm«Uw« being iiRid aodvtMij, 
CT"JMfajp. ''llf/iFj T^Hi reaoM » fary Tnwomwai 
imkfTk^ tAt the litiM, •> tl^ be died. And wbeo 
l£e iuMfaer ftW'Ae alo^ utd w tbe still pafe f»« cf ber 
iMfay rite riot iirr pamraitM, mhS^ tB the p«ci|de MJd 
"Thetit it DO liiiii^ BuTthen not owd «*pied the 
doc«/jr •]< the TiIlMpt. And qoieklj be apoke, Mfiac 
"TbYR ia the drjctor! ffi> you t« him, mojtiAp hell 
five your <^ild Uj jim a^m." Tbu on her koees, 
■ai'Hinn humbtr «hK besp^l the "wiac" nua. ''My 
dauKhtKT, t( you wixildat your child rt to TW fp you 
fnitn bouM !<> bMM» axtd bei; and iky "Givenieaome 
DWMtid i»d" tAit if thert be by aay chaaoe a dc*d 
BUD in that faouae, then leaTC the aeed, f or ■■ a child 
or atan or woman there baa dini, the dtann ia broken. 
Go, and if thou aucceedevt — 
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Special TeMa and Their Significance 



Name (Pupa No. t24). 



I. After the wuJte bit the chiM how Ytry md the 
mother was, ud she did every thing to try aad tarn 

U. The Btor; ma about this child that waa 
bitten by a anake and he wae (toiim to die and the 
mother tried to net aome muatard aeed but nobody 
^■^'^ any and the child died. 
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(Ht) HlffTOBT TlBT 

The history test followB much the same lines as the English 
test. None of the pupils showed evidence of familiarity with 
the subject matter. 

Admini^ation of Ae teat: Draw a map of Italy and Sicily on 
the blackboard, indicating the fdlowing provinces and cities: 
Piedmont, Genoa, Venice, Rome, Naples, Calabria, Mesuna, 
Palermo and Marsala. In addition to these places write the 
names "Garibaldi" and "Victor Emmanuel" on the board. 
Give orally necessary historical groundwork as follows: "Victor 
Emmanuel was the king of Piedmont. (Point out.) He had 
expressed his willingness to lead an insurrection to establish a 
free and united Italy whenever the other states of Italy shoiild 
revolt. The Two Sicilies (point out) and the other small states 
of Italy were governed by rulers who were opposed to a united 
and republican Italy. 

"These are all the facts that you will need to know to under- 
stand the selection about to be read. Hemember those points 
that you like and that you consider histoHcaUy important." 
(Allow 8 minutes for the reading.)* 

Hielory Teat 



1 modification of pp. 392^, 402-4, Sedgwick, A 8bor% 
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he always retained the jaunty, pallant bearing of a mariner. His countenance 
(childlike and honlike) — ^witn its broad tranquil brow, benign eye and reso- 
lute mouth — ^in youth all sparkling, gradually changed with care and dis- 
illusion, but he still kept the seaman's mien and the seaman's lightsome eye. 
He was the beau ideal of a romantic hero. After his unsuccessful raid into 
Piedmont he had gone to South America, where he lived a wild life of guerilla 
wajrfare, fighting uke a Paladin on behalf of republican revolutionaries who 
were stru^ling for their freedom. All the time he was training a band of 
Italian adventurers, his legion, so that they should be ready when their country 
had need of them. These men rushed to the defense of the city. Their entry 
was most picturesque. The ^unt soldiers, wearing red shirts and pointea 
hats topped with plumes, theu: legs bare, their beards full-grown, their faces 
tanned to copper color, with their long black hair dangling unkempt, looked 
like so man^ Fra Diavolos. At their head Garibaldi, in his red snirt, with 
loose kerduef knotted round his throat, the regular beauty of his noble, 
leonine face set off by his waving hair, mounted on a milk white horse, rode 
like a demigod." 

''A short time after what has just been read the following 
events took place:" 

"In the meantime Francis II, a weak, i^orant, bigoted lad, had mounted 
to the throne of the 'Two Sicilies.' In April, 1S60, a revolt began in Palermo, 
and, though suppressed there, spread. Two young patriots, Crispi and Pilo, 
went about stirrmg the people to action. Garibaldi was begged to put him- 
self at the head of the proposed revolution. On the night of May 6j two 
ships, the Lombardy and the Tiednumt, secretly left Genoa, and took Garibaldi 
and a thousand volunteers aboard. This band, known as Hhe thousand,' 
is nearly as famous and as legendary as King Arthur and his Round Table. 
On May 11, the ships landed at Marsala. Two cruisers from Naples came up, 
but two English men-of-war happened to be there also; and the English cap- 
tains, under guise of friendly notifications to the Neapohtans. took some 
action which delayed the latter long enough to let the last Garioaldians dis- 
embark. Once on shore Garibaldi's volunteers ran to secure the tele^aph 
office. They arrived just after the operator had telegraphed that two Pira- 
montese ships, filled with troops, had come into the harbor; a Garibaldian was 
able to add to the message, '1 have made a mistake; they are two merchant- 
men.' The answer came back, 'Idiot.' The volunte^ marched inland. 
A provisional government was organized; Garibaldi was made dictator, and 
Cnspi secretary of state. The cry was 'Italy and Victor Emmanuel!' Gari- 
baldi was joined by insurgent Sicilians, and, with numbers consideit^ly 
increased, fought and defeated the Bourbon army. The story reads like the 
exploits of Hector before the Greek trenches. Victory followed victory. 
Palermo felL Milazzo and Messina; then he crossed the straights and invaded 
Calabria. This marvelous triumph, for there had been thirty thousand troops 
to oppose Garibaldi, frightened King Francis; he proclaimed a constitution, 
but it was too late. Garibaldi swept on victorious, and the king fled from 
Naples (Sept. 6); the next day Ganbaldi marched in and assum^ dictator- 
ship of the Kingdom. 

''Victor Emmanuel took up the cause and, marching south, joined with 
the forces of Garibaldi and together they decisively ddeated the opposing 
army. In February, 1861, the first Italian parliament was held and Victor 
Emmanuel formally received the title of 'King of Italy.' Excepting Rome 
and Venice, Italy was free and independent." 

Questions as follows: 

(1) What do you think was probably the next important event? (2 
minutes.) 

(2) Describe the character and appearance of Garibaldi. (4 minutes.) 
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(3) Beginning with the departure of Garibaldi and his men from Genoa 
write a detailed accoimt of as much of the story as you have time for. (Bal- 
ance of time — 6 minutes.) 

Each paper was graded upon the following points, though the grading uix>n 
Ha, only, is used as the measure of the history test. Hw is used in connection 
with the English test. 

Ht Valuation — historical forecast and appreciation of the essential his- 
torical facts. (Grade approximately from to 10, with an average 
of 5. Further explanation follows.) 

H* Accuracy and extent of description. (Start with 4 and to this add i 
for each point correctly made and subtract 1 for each point incor- 
rectly made.) 

Hw Written esroression. (Grade from to 10, with an average of 5. Give 
some slignt weight to spelling.) 

Hd Dramatization. (Grade from to 10, with an average of 5.) 

The srading for valuation depended in part upon the answer to question 
(1). The grading of this historical forecast followed closely the scheme 
bcJow: 

Grade below: given for selecting the following as the next historical event: 

7d:l Drawine up a constitution. 

6d:l Peacefiu acquisition of Rome and Venice. 

5d:l Conquering of Rome, or of Rome and Venice. 

Garibaldi given some honor. 

Establishment of a government. 
4:^1 Peace for a short time and then revolts. 

Garibaldi rebels against Victor Emmanuel. 
3:^1 Failure to answer. 

2d:l Uprising and revolution by the people. 

Garibaldi made king. 

The plus or minus after each grade indicates the amount that quite generally 
18 to be added or subtracted, depending upon the answers to the second and 
third questions. For the second question. 

Add 1, or more, for genuine appreciation of the traits of character which 
were essential to Garibaldi's success. 

AddO for correct personal description. 

Add ~1 for incorrect personal description which does injustice to Gari- 
baldi's character, and for irrelevant but correct data, e. g., trip to 
South America. 

For the third question, 

Add 1 for correct references to motive and organization, e. g., "to establish 

a free and united Italy"; "formed a provisional government"; "joined 
by insurgent Sicilians"; "proclaimed a constitution"; etc. 

Add for correct narrative. 

Add ~1 for incorrect narrative which violates principles involved and for 

misunderstanding of oipinization, e. g., "Garibaldi sailed to Mai^ 
seilles and fought the lung of France"; or for attributing incorrect 
motives. 

As already mentioned the accuracv grading H* is the measure for the 
entire test for convenience multiplied by two, i. e., HtB2(Ha— mean).^ 

* See Appx., p. 99. 
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The reliability coefficient (tf Ht is .956 since the grades used are 
the sum of the grades given by two judges and the correlation 
between the latter, based on a sample of 36, is .916. 

In the following sample tests, given to illustrate the method of 
marking, the gradings for valuation and dramatisation are 
included though they are not used in obtaining the final score 
for the test. 

. Nome (Pupa No. 226). Date 



I. The next important event mif^t have been the 
taking of Venice and Rome hy Oaribaldi and Victor 
Emmanuel, ""iiring Italy a United Kingdom. 

II. Garibaldi wore a red ooat, high hat with a plum e 
and ix»ota. His character was a veryBtrong and good 
one. He dtaircd to do nood for hia country, therefofe 
fought well and won many TJctoriea. 

m. Garibaldi was a very brave soldiw who was 
■ent Igr the King of Piedmont, Victor Emmanuel. He 
and one Oiouaand men etartiB down to the aoutheni 
part of Italy, by water, lliey reached the moat soutb- 
«R1 of the two Sicilya, and conquered Palermo firat. 
A telegra^ had been sent just before their arrival 
and it said that theee men were coming to conquer 
them, but as Garibaldi reached there he BMg" "no that 
is not rii^ti we are merchants," bo anothw telegram 
was aent^ Garibaldi and his^men marched on to 
Maraalaandconqueredth&tcity. HewonvicUx? . . . 

Ht-2(H.-mean)-2C1.6-6.5)--10.0. 
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Nme (Pupa No. 235). 

I. The fall of Rome or Venice which wouM make 
all Italy independent! 

II. Garibaldi waa a acTnaniiire, strong phiqyealy 
and mental with a patriotic spirit. He had a 
handsome face, intelligeot eyes. Dmsed in phimed 
eap, red shirt and taoe bandana arauod his neck he 
looked quite fierce. 

III. It took us only a day to coast down lo Palermo 
where we disembarked as quickly as possible while 
to T'^iiii"*' cruisMB held up some of the ships of the 
KipK of Sicily. We captured the town and assured 
the King of Sicily over telegrajdi that no such thinn 
had h^tpened. We had soon eaptureJall the eoul£ 
«n citieB and were marching north to Capture Naplea 
but the King hearing of our approach fled. Kinn 
Emamiei came to our help and we soon bad all of tlie 
states eroept Rome and Venice which we soon e^>ect 
to hare. Our brare leadv Garibaldi is Dictator of 
Sicily. 

Ht-2{10-6.6)-7.0. 
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I. TIk eompletion of the Kingdom by cE^tturing 
Borne (cqieeuiUjr) and Venice; and making Emaauel'a 
iliiiii to the Utnme secure. 

n. Garibaldi, haTing been a aailor inherited their 
jarii] demeanw and carriai^. He was exceedinnly 
adTatturuuB. and, we hear of him in such oountriM 
a war. He was tanned by egpoaure 



1, atronK, muBcuhtf and athletic. He in- 
bMited a tcmit <A being able to nde sod gorern men 
■■ ia ahown by hia checkered career. He was 
pCTpetoally clad in a red ahirt and aometimea a 
kaiihirf of the same briUiant hue, encircled hia neck. 
Hia hair waa litmrioua and abundant which eet off hie 



III. In Aiwil 1860 Garibaldi left Genoa in command 
ot 1000 wtlunteera embarked on two PicdmontcBe 
TMBda. He reach Maraala and marched hia mta 
landward to Palermo which he captured . Palermo 
had prcvioualy rerolted and bis campaign was in 
accordance to it. From Palermo he Bailed to Calabria 
irfiich he captured. He proceeded northwards and 
waa joined by Emanuel. Tonetber thay captured all 
of Italy except Rome and Vaiice. Garibaldi aaaumed 
the title of Dictator. Francis, King of the two Sicilies 
abdicated. Carassi was made eecretary. Emanuel 
was proclaimed Kiim and the fiiat Parliament met 
1861. which rcprestpted all the individual states com- 
bined. (Deduct 1 for order of events) 
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Name (PupU No. 234). 



I. The fall of Rome wtm probably the aext impor- 
tant event, maybe Venice at the same time. 

II. Garibaldi was a strong man. Ae he had been in 
South America he vaa touahened to wild life. He wm 
a man who was strong as a general and could com- 
mand troopa well. 

He had black wavy hair and wore a red ebirt. 

III. When Garibaldi left Genoa secretly he took 
with tiim a thousand men. These men were like 
King Arthur and his Knighta of the Round Table . 
When they came near Marsala two war veesele from 
Naples followed them but at the same time t wo Rnglish 
men-of-war were there and they delayed the men-of- 
war from Naples. Ganbaldi reached Mawala and 
went to a telettraph office and waa jugt too late to etop 
amMsage Baying that th^ had arriTcd. He had the 
operator send the message that he mistook the vegeels 
and that they were only merchant veaeelB. 
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I. The two Sisliea were united, no doubt. 

II. Garibaldi must hAve been et«ra and had good 
diBcipline to manage bo nuny people, and train Italian 
soldiers. (He was perfectly honest as he said he 
would help Italy and did.) Garibaldi, waa tall, 
had dark wavy hair that fell in waves over his 
crigp black eyebrows, his eyes stood out like black 
tbamonda in a white velvet backgroun3^ Garibaldi 
wore a flarion red shirt. 

III. Garibaldi left Genoa with a crew of a thousand 
men, sailed directly southward to Palermo; when the 
people there heard that vessels had landed they sent a 
wireless of the news and also for help. Garibaldi 
arrived just in time to add a few words to the message. 
After he had oonquored and captured Menaina. and 
the other cities he worked his way north where 
another force joined him and together they captured 
HapleB. 



Ht-2(-l-«.5)--IB. 



4 


H, 

2 


H, 


B. 


{=■ 








,5 








{-.^ 








{=1 

5 








-I 
-5 


-I 






^1 


1 


7.5 


8.6 



(Mi, Ei, Hi,) Interest Tkbts 

In attempting to test a pupil's interest in some given high 
school subject an error would likely be introduced if that subject 
alone were dealt with, as the pupil would readily see the object 
of the test and, possibly unconsciously, be influenced thereby. 
For purposes of tapping a pupil's personal preference it is very 
much more signihcant for him to say that of all vocations he 
prefers that of teaching mathematics, than for him to reply in 
the affirmative to the question "Would you rather teach mathe- 
matics for a vocation than to do anything else?" This illustra- 
tion serves to emphasize the difference' in the nature of response 
of an individual when he is indicating a spontaneous preference 
from his response when he is accepting or rejecting a controlled 
choice. 

In order to insure such spontaneity and freedom <^ choice, an 
interest test was so devised aa to cover impartially all the ordi- 
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nary interests of a pupil. Because this test covers so broad a field 
it may be used equally well to measure a pupil's interest in lines 
other than mathematics, English and history, which are the 
lines for which its significance has been evaluated in this study. 
When graded along the line of English, the grade of this test is 
designated by Ei, along the line of mathematics by Mi, and 
along the line of history by Hi. The grading of this test is 
accomplished by means of tables given on succeeding pages. 
Administration of test: The pupils were told to answer the ques- 
tions on the sheets handed them. As much time as was needed 
was given — most of the pupils finishing the task in 40 minutes. 



Interest Tests 

Name Date 

1. Go throu|di the accompanying list of magaiines and put an x opposite 
those with which you are not familiar, that is, opposite those of which you have 
never looked through at least two numbers. 

1. All Story 27. Hearst's fiO. Pictorial Review 

2. American Boy 28. Home Needlework 51. Popular Mechan- 

3. American 29. Ill'd London News ics 

4. Argosy 30. L'iUustration 52. Popular Science 

5. Atlantic Monthly 31. lUustrirte Zeitung Monthly 

6. Black Cat 32. Industrial En^g 53. Printer's Ink 

7. Blue Book 33. International Stu- 54. Puck 

8. Bookman dio 55. Red Book 

9. Cassier's 34. Ladies Home Jour- 56. Review of Reviews 

10. Century nal 57. St. Nicholas 

11. Collier^s Weekly 35. LaFoUette's 58. Saturday Evening 

12. Commoner 36. Leslie's Weekly Post 

13. Cosmopolitan 37. Life 59. Science 

14. Count^ Life in 38. Lippincott's 60. ScientificAmerican 

America 39. Literary Digest 61. Scribner's 

15. Craftsman 40. McClure's 62. Smart Set 

16. Current Literature 41. Metropolitan 63. Strand 

17. Delineator 42. Modem Priscilla 64. System 

18. Electrical World 43. Moving Picture 65. Technical World 

19. Etude World 66. Theatre 

20. Evervbody's 44. Munsey's 67. Woman's Home 

21. Good Housekeep- 45. Musician Companion 

ing 46. Natiofnal Geo- 68. Wilshire's 

.22. Graphic graphic 69. Workl's Work 

23. Green Book 47. Outing 70. Youth's Compan- 

24. Hampton's 48. Outlook ion 

25. Harper's Weekly 49. Photographic 

26. Harper's Monthly Times 

Go through the list ai^uai, marking the five that interest you most A, B, C. 
D and E: A lor the most interestinjg of all. B for the next most interesting, ana 
so on. Do not spend much time in deciomg exaeUy upon your preferences. 

2. Briefly tell why you particularly enjoy reading the magasine that you 
have marked A. 

3. Name three books which you have read in the last two years that have 

interested you very much. 1 

2 3 
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* 4. Suppose that you have an hour's leisure time, in what outdoor amuse- 
ment would you prefer to spend it? 

* 5. Suppose that you have an hour's leisure time, in what indoor amusement 
would you prefer to spend it? 

6. Of the two amusements named in your answers to questions 4 and 5 
which do jrou prefer? 

7. If you had the opportunity, which one of the following would 3rou attend, 
supposing each of them to be first class of its kind? Mark it A. 

1. Moving picture entertainment. 9. Boxing contest 

2. Circus 10. Band concert 

3. Football game 11. Political ndly 

4. Baseball game 12. Light opera 

5. Track meet 13. Diama 

6. Musical comedy 14. Lecture, or stereopticon lecture, 

7. Vaudeville performance on a subject that interests you. 

8. Grand opera 

8. What occupation would you prefer as a life work? 

Which would you like next best? 

9. In the foUowing list of words mark with a 3 those you know the meaning 
of perfectly and could define as a dictionary does. 

If you can explain in a general way the meaning of the word and would 
understand it when used in a sentence mark it with a 2. 

If you cannot explain its meaning but are vaguely familiar with it, mark it 
with a 1. 

If the word is entirely new to you and unknown, mark it with a 0. 

In doing this, go through the list four times, the first time marking the 3's, 
the seoonoi time the 2's, the third time the I's, and the last time the O's. 

1. simile 32. physical valuation of railroads. 

2. primary election 33. score (in music) 

3. Mason and Dixon's line 34. commercial fertilizer 

4. creed 35. Magna Charta 

5. Acropolis 36. voucher 

6. rip saw 37. ohm 

7. hydrogen 38. strins halt 

8. compound interest 39. fourtn dimension , 

9. cube root 40. piston rod 

10. paradox 41. Pythagorean proposition 

11. Saracens 42. single tax 

12. I. W. W. 43. stamen 

13. Whigs 44. hemstitch 

14. theoeophy 45. Spanish Armada 

15. toga 46. statute of limitations 

16. block plane 47. coherer 

17. NaCl 48. vertebrate 

18. fissure 49. parallelogram 

19. equation 50. omelette 

20. guillotine 51. Reichstag 

21. prose 52. Commerce Court 

22. midicalism 53. states' ri^ts 

23. HsO 54. space bar 

24. transubstantiation 55. giblets 

25. gladiator 56. Australian ballot 

26. debit 57. moUusk 

27. gravity cell 58. perspective 

28. strata 59. nreless cooker 

29. improper fraction 60. mortgagee 

30. lever 61. referendum 

31. ragtime 62. Formosa 
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10. Tell what each of the following words means as well as you can. 

a. simile 

b. cube root 

c. improper fraction 

d. ragtime 

e. physical valuation of railroads 

f . conmiercial fertiliser 

g. ohm 
. Pythagorean proposition 

i. single tax 

j. hemstitch 

k. vertebrate 

1. parallelogram 

m. omelette 

The last two questions are not solely for the purpose of testing 
the pupil's interest, as they test his range of information as well. 
They constitute a vocabulary test in which the words were chosen 
because of their specific bearing upon all the usual high school 
courses and in addition upon religion and politics, in order to 
cover the intellectual field. 

Anyone who has read the answers of a few pupils to the ques- 
tions in this test must feel that strong individual differences are 
shown. There is much to indicate that the data are highly signifi- 
cant as evidence of interest, but the problem of expressing this 
in numerical terms and with reference to specific high school 
courses is far more elusive than simply the determination that 
the data are significant. For purposes of evaluation, it would be 
possible, theoretically, to have a large number of judges grade 
each pupil's paper upon the various questions with reference to 
the significance of each of the questions in turn as evidence of 
interest, severally, in mathematics, English and history. Prac- 
tically this method is valueless, as judges with sufficient leisure 
and patience could not be found and because their work would 
apply only to the actual papers graded and would be of no aid to 
another party desiring to give the test. A result embodying all 
the advantages of the former method and none of its disadvan- 
tages, can be obtained by having a sufficient number of judges 
grade the questions for all the probable answers. With a table 
of such gradings for each question, it is then only a matter of a 
single grader comparing the answers of the pupils with the grad- 
ings of the tables. Anyone is then able to give and grade the 
test with an accuracy which is very nearly as great as the accu- 
racy of the original grading of the expert judges. This second 
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method, which has been used, will be clearer when illustrated by 
reference to the specific questions. 



Grading of the Interest Tests 

Questions 1 and 2 — Magazines. 

Each of the magazines listed was graded from zero to ten for its significance 
as evidence of interest and information along the line of English and again 
with reference to history, b^ four judges (except that onlv three graded fifteen 
of the least familiar magazmes), three of whom are psychologists and familiar 
witli grading of this nature, and the fourth a librarian. The average, to the 
nearest integer, of the ^p^es of the different judges is the grade given for each 
magazine in the followmg table: 



Grade 



Grade 



Eng. 


Mitt. 


1 





2 


1 


5 


5 


1 





10 


4 


1 











8 


2 


2 


1 


7 


4 


4 


7 


6 


9 


4 


2 


5 


1 


5 


1 


9 


4 


3 





3 


1 


3 


2 


5 


5 


4 


2 


4 


7 








4 


5 


4 


6 


6 


3 


4 


6 


3 





4 


7 


4 


7 


4 


7 


3 


2 


3 


2 


4 


1 


5 


9 


4 


7 



1. All Story 

2. American Boy 

3. American 

4. Argosy 

5. Atlantic Monthly 

6. Black Cat 

7. Blue Book 

8. Bookman 

9. Cassier's 

10. Century 

11. Collier's Weekly 

12. Commoner 

13. Cosmopolitan 

14. Country Life in 

America 

15. Craftsman 

16. Current Literature 

17. Delineator 

18. Electrical World 

19. Etude 

20. Everybody's 

21. Good Housekeeping 

22. Graphic 

23. Green Book 

24. Hampton's 

26. Harper's Weekly 

26. Harper's Monthly 

27. Hearst's 

28. Home Needlework 

29. Ill'd London News 

30. L'illustration 

31. lUustrirte Zeitung 

32. Industrial Eng'g 

33. International studio 

34. Ladies'Home Journal 

35. LaFoUette's 

36. Leslie's Weekly 



Eng, 

3 
5 
7 
5 
1 
3 
1 

1 
3 
5 
3 
7 
3 
2 
2 
2 

1 
2 

5 
6 
4 
3 
3 
7 
3 
2 
2 
2 
1 
4 

3 
5 
5 



Hist. 

1 
2 
7 
4 




1 
2 
9 
1 
8 
2 

1 
1 


1 

8 
1 
4 
2 
3 
3 


1 
1 

1 

4 
8 
2 



37. Life 

38. Lippincott's 

39. Literary Digest 

40. McClure's 

41. Metropolitan 

42. Modem PrisciUa 

43. Moving Picture 
Work! 

44. Munsey's 

45. Musician 

46. National G60gn^>hic 

47. Outing 

48. Outkx>k 

49. Photo^phic Times 

50. Pictorial Keview 

51. Popular Mechanics 

52. Popular Science 
Monthly 

53. Printer's Ink 

54. Puck 

55. Red Book 

56. Review of Reviews 

57. St. Nicholas 

58. Saturday EVg Post 

59. Science 

60. Scientific American 

61. Scribner's 

62. Smart Set 

63. Strand 

64. System 

65. Technical Workl 

66. Theatre 

67. Woman'sHomeCom- 

panion 

68. Wilshire's 

69. World's Work 

70. Youth's Companion 
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The correlatioiui between the grades given by judges 1, 2, 3 and 4 are as 
follows: 



nt 


.887 


rii 


.893 


ri4 


.867 


ru 


.788 


ru 


.920 


Th 


.821 



Average .863 

Taking the number of judges for each magazine as three and one-half, the 
reliabilitjr coefficient equals .956. 

The smgle grade given for these questions is the average grade for the 
magaiines after altering the Krade of the magazine marked " A " ^unuJly about 
li points) upon the basis of the answer to question 2, and weighting mBf$r 
sines A, B, 0, D, and E lO, 8, 6. 4, and 2 respectively. The sample gradmg 
of the entire test, given on page 56, will show the steps in detail. 

The reliability coefficient for the grading of each ma^ptzine is .956, but the 
reliability of the aversjjge of a number of such mdes is higher. A factor tend- 
mg in the other direction is the method of (grading the magazine marked ''A. " 
The alteration of the (fnde of this magazme is not arbitrary, but left to the 
grader, and therefore its reliability is somewhat less than that of the maga- 
zines that have been sraded by three or four fudges. The net result of these 
two factors is probably to make the reliabiUty of the grade given for the 
Question about the same as the reliability of the grading of the magazines by 
the judges. 

Question 3 — Books, 

The establishment of a guide for the grading of question 3 ofifers greater 
difficulties than was the case with question 1, for the reason that the number 
of books which may be pn^erred is unlimited. However, quite a number of 
books were repeatedly chosen, so that a grading for books for English and 
history covering 300 or so of the most frequent choices does cover a very large 
p^ cent of the Sooks chosen. Furthermore, as each pupil chooses three Dooks, 
it is much more than likely that two of the three willlbe books that are graded, 
or books by the same author as graded books, so that the grading actually is 
quite objective. The following is such a list, and the grades given, expressed 
as deviations from the mean, are the averases of the grades of m>m two to four 
judges, about one-half beuig graded by tluree or more judges. This list of 
about 300 titles is part of alarger list which included all the books i)referred 
by the pupils. The larger list was V^en to four judges — ^two librarians and 
two others familiar with such work. The directions to the judges were to grade 
the books for En^h and history according to the following scheme: 

GiukDB English Histobt 

1 The best literature. Straight histories. 

2 Excellent. Books that are mainly historioaL 

Historical biographies, etc. 

3 Good. Partly historicaL HiBtorical fiction. 

4 Medium. Fiction or adventure with traces of 

historical material. 

5 Poor. Adventure, etc., with no claim to any 

historical matter, but with liveqr 
action and plot. 

6 Very poor — soni-trashy. Non-historical fiction. 

7 Pure trash. Books with neither plot nor historical 

background, e. g., Electricity for 
Beginners. 
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The average correlation between the grading of two judges is .882 for the 
English grading, and .720 for the history grading. The reliability coefficient, 
calling the number of judges 2}, is, for the English grading .947, and for the 
histoiy grading .861. Since all the books chosen are not in the following list, 
and since certain of those not so listed can be graded if the grader is familiar 
with the book or with the author, the reliability of the resulting grade of eadi 
book is somewhat less than the reliability coefficient just given. 

The gradings from 1 to 7 of the different judges were combined into single 
grades, expressed as deviations from the mean,^ and this is the grade given in 
the foUowing table: 



Author 



Title 



Grade 







Eng, 


Hisi 


Scott 


Abbot 


1.2 


1.2 


Eliot 


Adam Bede 


^.0 


-.2 


Clemens 


Adventures of Tom Sawyer 
Adventures of Sherlock Holmes 


.2 


.0 


Doyle 


- .2 


.0 


Roosevelt 


African Hunt 


- .2 


.0 


Maeterlinck 
Irving 


Aglavine and Lysette 
Alhambra 


.9 
1.4 


- .8 
2.2 


Mon^meiy 


Ann of Avonlea 


- .4 


- .8 


u 


Ann of Green Gables 


~ .4 


- .8 


Locke 


Aristide Pujol 


- .2 


- .8 


F. H. Smith 


Armchair at the Inn 


- .2 


- .8 


Franklin 


Autobiography of Benjamin Franklin 


.2 


1.5 


Stanley 


Autobiography of Henry M. Stanley 


.2 


1.5 


Haggara 


Ayesha 


-1.2 


- .8 


Wallace 


Beji Hur 


.6 


1.2 


M.Warde 


Betty Books 


- .8 


- .8 


McCutcheon 


Beverly of Graustark 


-1.7 


- .4 


Thompson-Seton 


Biography of a Grizzly 
Birds' Christmas Carol 


- .2 


- .4 


Wigfnn 


.1 


- .8 


Stevenson 


Black Arrow 


.8 


- .6 


Vance 


Black Bag 


-1.5 


- .8 


White 


Blazed Trail 


.2 


.9 


Dickens 


Bleak House 


1.2 


- .2 


Famol 


Broad Highway 


- .6 


- .4 


London 


CaU of the Wild 


.4 


.5 


Kipling 


Captains Courageous 

Casting Away of Mrs. Leeks and Mrs. 


.4 


- .4 


Stockton 








Aleshine 


.0 


- .8 


Garland 


Cavanaugh, Forest Ranger 


- .6 


.4 


Dumas 


Chevalier de Maison Rouge 


.5 


1.2 


« 


Chicot the Jester 


.5 


.2 


Dickens 


Christmas Carol 


1.3 


— .8 


Churchill 


Coniston 


.1 


.6 


L. Scott 


Counsel for the Defense 


- .3 


- .8 


Dumas 


Count of Monte Cristo 


.6 


.8 


tt 


Countess de Chamy 


.6 


1.2 


Gaskell 


Cranford 


.1 


- .6 


Barbour 


Crimson Sweater 


- .8 


- .8 


Churchm 


Crisis 


.1 


1.2 


tt 


Crossing 


.1 


1.2 


Trowbridge 


Cud jo's Cave 


-1.7 


- .4 


Rostand 


C3rrano de Bergerac 
01. 


1.4 


.9 


^See Appx. p. li 
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AUTHOB 


Title 


Grade 






Er^g, 


Hist 


Eliot 


Daniel Deronda 


1.4 


.6 


SteyeDBon 


David Balfour « 


.8 


.6 


Dickens 


David Cqpperfield • 
Dawn O'Hara 


1.1 


- .4 


Ferber 


- .6 


- .7 


Agui]ar 


Days of Bruce 


- .3 


1.1 


Cervantes 


Don Quixote * 


1.2 


.9 


Dickens 


Dombey and Son 


1.1 


- .4 


Major 


Dorothy Vernon of Haddon Hall 
Dri and I 


- .6 


.7 


Bacheller 


.1 


.9 


« 


Eben Hokien 


- .2 


- .6 


Alcott 


Eight Cousins 


- .2 


- .8 


Tennvson 
Longfellow 


Enoch Arden 


1.3 


- .8 


Evangeline 


.4 


.9 


Dnimmond 


Evolution of Man 


.2 


.4 


Spenser 


Faerie Queene 

Fall of the House of Usher 


2.1 


- .8 


Poe 


1.2 


- .8 


Gabonau 


FHe Number 113 


.1 


.0 


Fothergill 


First Violin 


- .4 


- .8 


Chaplin 


Five Hundred Dollars 


-1.6 


- .9 


Porter 


Freckles 


- .4 


- .8 


Read 


Foul Play 


.2 


.0 


Poe 


Gold Buff 
Graustark 


1.2 


- .8 


McCutcheon 


-1.7 


- .6 


Dickens 


Great Expectations 


1.1 


- .5 


Holmes 


Gretchen 


-2.7 


- .8 


Shakespere 


Hamlet 


2.3 


.4 


Dodge 


Hans Brincker 


- .8 


- .6 


Porter 


Harvester '^' ^ 


.1 


.2 


Thackeray 


Henry Esmond 


1.4 


.9 


Shakespere 


Henry V 

Her Little Youn^; Ladyship 


2.3 


.9 


Kelly ^ 


- .4 


- .8 


Redpath 


History of Amenca 


.4 


3.5 




Hollow of Her Hand 


-1.4 


- .9 


Leblau 


Hollow Needle 


- .2 


.0 


Ford 


Honorable Peter Sterling 


- .4 


- .2 


Miilford 


Hopalong Casskly 
Hound of the BaskerviUes 


- .9 


- .8 


Doyle 


- .2 


.0 


Hawthorne 


House of Seven Gables 


1.2 


- .8 


Rohlffl 


House of the Whispering Pines 


-1.2 


.0 


Clemens 


Huckleberry Finn 


.2 


- .6 


Clemens 


Innocents Abroad 


.2 


- .8 


Davis 


In the Fog 

In the Palace of the King 


- .4 


.1 


Crawford 


- .2 


.7 


Deland 


Iron Woman 


- .4 


- .8 


Scott 


Ivanhoe 


1.2 


1.2 


McCutcheon 


Jane Cable 


-1.7 


- .8 


Bronte 


JaneEvre 
Janice Meredith 


.8 


- .8 


Ford 


- .4 


1.2 


Craik 


John Halifax, Gentleman 


.2 


- .8 


Kipling 


Jungle Book 


.4 


- .8 



t' 
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AUTBOft 



Title 



Gbadb 



SooU 
arnith 



ICt plmg 

Ining 

¥^illiam8oa 
SooU 

Lytton 
Cooper 
Reed 

JohnstoQ 

« 

KipUng 

Dickens 

Aloott 

Banie 

Fox 

Aloott 

Blackmote 

PaniBh 

Rice 

Austen 

Rinehart 

London 

Dickens 

Bosher 

ZayogwiU 

OHreUi 

Eliot 

Manyat 

Hugo 

Unooln 

Barclay 

Rice 

Abbott 

CoUiDS 

Norris 

^Mannan 

Verne 

Beach 

Thackeray 

Dickens 

Hugo 

Homer 

Dickens 

Page 

Dickens 

Bumham 





Eng, 


HiH 


Kenihrorth 


1.2 


1.2 


Kennedy Square 


- .4 


- .8 


Kidni4>ped 


.8 


.5 


Kim 


A 


- .6 


Knickerbocker Hktory of Neir York 


.8 


.8 


Lady Betty Acroas the Water 
La^oC the Lake 


-1.4 


- .8 


1.2 


.5 


Lamplighter 


- .9 


- .6 


Last Days of Pompeii ^ 


.8 


1.2 


Last of the M<^iicans . 


V .4 


.9 


Lavender and Old Lace 


-1.7 


- .8 




.5 


2.2 


Little Colonel in Arisona 


- .9 


- .8 


Little Cok>ne1 at Boarding School 


- .9 


- .8 


Light that Failed 


.2 


- .8 


Little Dorrit 


1.1 


- .4 


Little Men 


,1 


- .8 


Little Minister 


J /.6 


- .8 


Little Sh^herd of Kingdom Come 


•- .4 


- .2 


Little Women 


.1 


- .8 


LomaDoone 


.2 


.9 


Love imder Fire 


— .8 


.2 


Lovey Mary 


- .6 


- .8 


MansfiekiPark 


.5 


- .8 


Man in Lower Ten 


-1.0 


- .6 


Martin Eden 


.5 


- .8 


Martin Chuulewit 


1.1 


- .2 


Mary Cary 


- .8 


- .8 


Master 


.2 


- .8 


Master Christian 


-1.2 


- .8 


Mill on the Fk)ss 


1.4 


- .8 


Mr. Midshipman Easy 


-1.2 


- .8 


Miserables, Les 


1.3 


1.2 


Mr. Pratt 


-1.2 


- .8 


Mistress of Shenstone 


- .7 


- .8 


Mrs. WiggR of the Cabbage Ptttch ' v^ - .6 


- .8 


Molly Make-beUeve 


- .6 


- .8 


Moonstone 


- .2 


- .8 


Mother 


- .4 


- .8 


Mother Carets Chickens 


- .4 


- .8 


Mountain Divide 


- .8 


- .6 


Much Ado About Nothing 


2.3 


- .8 


Mystmous Island 


-1.2 


- A 


Ne'er Do WeU 


- .9 


- .4 


Net 


-1.2 


- .8 


Newcomes 


1.4 


- .6 


Nicholas Nickleby 


1.1 


- .2 


Notre Dame 


1.3 


.5 


Odyssey 

Okl Cunnsity Shop 


2.3 
1.1 


.9 

- .4 


Oki Gentleman of the Black Stock 


- .2 


- .8 


Olivo- Twist 


1.1 


- .4 


Open Shutters 


- .8 


- .8 
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Author 


TlTLB 


Grade 




; 1 


Eng. 


Uia. 


Darwin 


Origin of Species , ' ^ 


i/- .6 


- .4 


Alcott 


Our Helen ' ' 


.2 


- .8 


Dickena 


Our Mutual Friend 


1.1 


- .4 


£. Bmith 


Palace Beautiful 


-1.2 


- .8 


Cooper 
We1l8 


Pathfinder 


.2 


.7 


Patty's College Days 


-1.2 


- .8 




Personal Memoirs of U. S. Grant 


- .4 


2.6 


DickeDB 


Pickwick Papers 


1.1 


- .1 


Cooper 


Pioneers 


- .2 


.3 


Flammarion 


Popular Astronomy 


- .9 


-1.4 


Austen 


Pnde and Prejudice 


.4 


- .8 


Clemens 


Prince and the Pauper 


.2 


- .8 


Johnson 


Prodigious Hickey 


-1.2 


- .8 


Aldrich 


Prudence Palfrey 


.1 


- .6 


Harrison 


Queed 


.1 


- .4 


Scott 


Quentin Durward 


1.1 


1.2 


Sienkiewics 


Quo Vadis 


.4 


1.2 


Homnng 


Raffles 


-1.7 


- .4 


Jackson 


Ramona 


.4 


.5 


Wiggin 


Rebecca of Sunnybrook Farm 


- .2 


- .8 


Lytton 


Rienzi 


.8 


1.2 


Parkman 


Robin Hood 


- .8 


.5 


Thompson-Seton 
LeGsilienne 


Rolf in the Woods 


- .2 


- .4 


Romance of Zion Chapel 


.1 


- .8 


Eliot 


Romola 


1.9 


.9 


Barclay 


Rosary 


-1.2 


- .8 


Alcott 


Rose m Bloom 


.1 


- .8 


Hope 


Rupert of Hentzau 


-1.0 


- .4 


Hawthorne 


Scarlet Letter 


1.1 


.3 


Porter 


Scottish Chiefs 


- .4 


-1.2 


London 


Sea Wolf 


.5 


- .4 


Kipling 


Seven Seas 


.5 


- .8 


Haggard 


She 


-1.4 


- .4 


WiSS 


Shepherd of the Hills 


.1 


- .8 


Goldismith 


She Stoops to Conquer 


1.1 


- .4 


Eliot 


Silas Mamer 


1.9 


- .2 


Porter 


Song of the Cardinal 


.1 


- .8 


London 


Son of the Sun 


.5 


- .8 


Barr 


Souls of Passage 


- .9 


- .8 


Reed 


Spinner in the Sun 


-2.2 


- .8 


Cooper 


Spy 


.4 


1.2 


Schreiner 


Story of an African Farm 


- .4 


- .2 


KeUer 


Story of My Life 
Stover at Yale 


- .2 


- .8 


Johnson 


- .9 


- .8 


King 


Street Called Straight 


-1.0 


- .8 


Vaile 


Sue Orcutt 


- .8 


- .6 


WysB 


Swiss Family Robinson 


- .7 


- .2 


Dumas 


Taking the Bastile 
Tale of Two Cities 


.5 


1.2 


Dickens 


1.1 


1.2 


Scott 


Talisman 


1.1 


1.2 


Jacobs 


Texas Blue Bonnet 


-1.0 


- .8 


Porter 


Thaddeus of Warsaw 


- .3 


.8 



so 



Bdueatumal Gvidanee 



AUTHOK 



DmuM 



Glyn 

McCuteheoo 

Verne 



Stowe 



Heoty 
AJeott 

ThickenY 
GoldnHh 
Wteter 

Soott 

Reed 

Malone 

Doyle 

London 

Thompeon-Seton 

King 

Scott 

Rohtfe 

Hawthorne 

Alger 
Bennett 



Tru 

Thooglitfl of Blareia AnreliaB 

Three Gumrdamen 

Three Men In a Boat 

Three Weeks 

T^iixton King 

Twenty Thousand Leagues under the 



Uncle Tom's Cabin 
Under Two FbgB 
Under Drake's Flag 
Under the li-nfut 

Vanity Fair 
Vicar of Wakefidd 



Waverlcy 

Weaver of Dreams 

West Point Yearling 

White CkHnpany 

White Fang 

Wild Animals I Have Known 

Wiki OUve 

Woodstock 

Woman in the AlooTe 

Wonder Book 

Young Adventurer 
Your United States 



Eng. 


HUl 


.7 


- .1 


.5 


1.2 


.4 


- .8 


2.3 


- .8 


1.7 


- .8 


1.2 


- .8 


.2 


.9 


.4 


.5 


2.4 


.9 


.1 


- .8 


1.4 


- .2 


1.1 


- .8 


.2 


- .8 


1.1 


1.2 


1.7 


- .8 


.6 


- .8 


.2 


.3 


.4 


« .8 


.2 


- .4 


.8 


- .8 


1.1 


1.2 


1.6 


.0 


1.1 


- .8 


2.2 


- .8 


.2 


.3 



The grade for question 3 is the avoage grade for the three books, weighting 
the first, second and third choices 3, 2, and 1 resi)ectiyelY. 

Since this grade is an ayerase of three grades, its reliability is greater than 
that of a sing^ book, and is probably close to .94 for English and .86 for history. 

Questions 4, 5 and 6 — Sports. 

The same general method used in establishing a guide for the grading of 
books, has here becsi used in drawing up a guide for the grading of sports, 
except that the grades were not expressed as deviations from a mean. The 
grading was on a basis of zero to ten, and the judges consisted of three per- 
sons experiCTiced in such grading. The avoage oomlation between the grad- 
ingB of the different judges, when Knglish and history are combined into a 
single correlation table, is .239. The reliability ooemciCTit for the grading 
is^ therefore, .486. The grading is separate for the preferences of bojrs and 
girls, as shown in the following table: 




Special Tata and Thtir Significance 



Motoring. . 



BadtrtbaU 

Bicycling 

Caida 

Domertic activities (cooking, sewing, etc.) . 
Drawing, painting 



fishing. . 
F^oti^.. 



1 



Hockey 

HtwMack riding 2 

Pool or billiards 

Musical practice 2 

Reading 9 

Bowing or sailing 1 

Shop work 2 

~ ■■ 1 



M 


G 

E 


? 


3 


2 


1 


7. 


1 


2 




K 






3 


1 


1 


I 

1 


1 
2 


7. 





2 


2 


2 


« 


■A 


1 


it 




a 


1 




1 





fi 


V 




7. 


1 


2 


•2 



Swimming 

Theatre 

Rumung games 

Walking 

Watching a game 

The pade for the queetion is the average, counting the indoor choice once, 
the outdoor choice once and the preference once. Since this grade is an 
average of three, one of them, however, a repetition, there is a slight tendency to 
increase the reliability of the grading over that of each sport singly. Thia 
tendency is probably counterbalanced by the fact that all poeaible sports are 
not includea in the above list, and the grader must at times use his judem«nt 
in the matter. In view of these two facts, it is likely that the reliabihty of 
the grading is about .48. 
Question 7 — EtdertainmenU. 

The general method used in establishing a guide for the grading of magaiinee 
was followed here. Grading was upon the basis of sero to ten, and the jud{|ee 
consisted of four persons experienced in such work. The averaf^ correlation 
between the Kradings of the judgee, combining English and history into a 

Binglecorrel8tiontabIe,is.929,»othattheroliabiBtyci "■ ' 

equal to .981. The grading follows: 

Entbrtainiuntb 
Moving pictures 

Football game 

Baseball game 

Track meet 

Musical comedy , 

Vaudeville 

Grand opera 

Boxing omteat 

Band concert 

Political rally 

Li^t opera 

Lecture, or stereoptictm lecture on a subject that mterests you . . 



>y coefficient of the grading is 
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Hfre again, tlie nmnlMr of c h oieM ■ 
the gTMlmc of qiarta ■ tlw one followed. The 
drawD xg> aftff yammalioa of aO the ehoinsaf 
r jniiiua. Tlw aToage eorrciatioa between 



foUowm^ bat of Toealioaa wm 
'Uwpopila, and waa graded bj 
the gndmfa of the differoit 



a am^ tabk, ■ .693, BO that Uw refiabiUj ooefficient of the grading ia .901. 



Carpenter 

Decorator or HiignM- . . 

Doctor 

Joumaliat 



Electrical.. 

CiTil 

Marine 

Mechanical. . 

Mining 

Strurttml... 

FanniDg 

Foreatry. . 



Lectunr 

LibrariaD 

Milliner 

MuMciao 

Membvof navy-- 

Nunc 

Ptditieian 



Charitr worker. . 



£ 
7 
6 


Gnu 
H H 
4 
e 1 


i 9 


7 2 






1 * 


4 6 


1 4 

IS 

1 

2 

7 
« 
8 
1 
3 

4 

8 
4 
6 
3 
S 
6 
30 
S 
5 


5 3 

5 4 

8 2 

2 "2' 

' 2 "'i' 

6 2 
8 1 
8 1 

2 1 

3 2 

■ 4 "2' 

' 7 's' 

4 2 

6 4 

3 2 
8 7 

4 4 
8 4 
« 3 
4 2 



Teaeher. . 

Domeatic acience, . 

Rn glnlh 

Kinder^uten 

Phyaical training o 

Queation 9 — Voeabuiarj/. 

"of the WOT „ „ 

number of words are Kraded lero by all the judges for their eig- 
ninconce m one or all of the three unea, and as these do not enter into tos 
grade which the pupil received, they have been omitted in calculating the 
reliability of the Krading for mathematics, English and history, thou^ aimpt; 
aa a measure of the reliabiUty of the grading this is not desirable. The inclu- 
aion of these zero grading^ would increase the reliability coefficient, llie 
reliability differs considenibly for Englieb from that for mathematics and 
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history so that the coefficients are calciilated separately. The average cor- 
relation for the different judges, excluding the seros. as stated, between the 
grading? of the words, equals for mathematics .786; for English .542; for his- 
tory .795, and the average for all is .707. Since three judges graded all the 
words, the reliability coeliciCTits for the grades of these subjects are .916 for 
mathematics, .780 for English and .921 for history; an average of .872. 
The nrade the pupil receives for mathematics is the sum of the various 



words cl&ecked, after it has been multiplied by the factor of accuracy obtained 
in the last question j and similarly for Endisn and historv. Since this grade 
is made up of a considerfU>le number of grades, whose reliability is givoi above, 
the reliability of the grade, before multiplication by the factor of accuracy, 
is appreciably greater than the reliability of the grading of each of the words, 
and IS probably not less than .96 for mathematics and history, and not less than 
.92 for English. 

As given in the next section, the reliability of the factor of accuracy is 
about .95, so that the reliability of the grade for the question is close to .91 
for mathematics and history and in the neighborhood of .87 for English. 

Question 10 — Factor of Accuracy. 

To determine the accuracy of the pupil's estimate of his knowledge, he is 
asked to define 13 of the words upon which he has previously expressed a judg- 
ment as to his familiarity with them. His defimtions of these 13 words are 
graded 1, 2, 3, or 4. The sum of these grades gives a quantitative statemoit 
of the extent of the pupil's knowledge of the 13 words. This sum, which may 
be cidled the measure of the pupil's actual knowledge, divided by his claim^ 

S'ves the factor of accuracy sought. In adding up the marks which constitute 
le pupil's own claim, it will be noticed that not infreauaitly the pupil has 
erased or marked over his previous marking, giving himself a lower mark in the 
second case. In all such cases the first grade put down by the pupil is the grade 
used. A magnifying glass may be of assistance, though it is seldom needed, 
the pupil making the correction probably not because he wishes to be dis- 
honest, but because he realizes that he has over-estimated his knowledge and 
wishes to be honest and straighten it out. 

The reliability of this factor of accuracy is undoubtedly high, and is esti- 
mated at .95. 

Two Kinds of Relidbiliiy Coefficients 

The reliability coefficients given, mean simply that the sradings of the 
questions as determined by the grader with the help of the tables formulated 
by the various judges, would probably correlate witn the gradings determined 
by a second grader with the help of tables drawn up by a second set of judges, 
to the extent indicated. They do not mean that the grading? of the prefer- 
ences of the pupils would correlate with similar gradings derived from different 
but similar data, to the extent indicated. The extent of this latter correla- 
tion can be determined for those (luestions that are not exhaustive, i. e., those 
for which a second similar test is possible. The vocabulary ana the factor 
of accuracy questions fulfill these conditions. For the vocabulary test it 
would only be necessary to devise a second list of words, as similar as possible 
to the words in this list, have their siflpiificance evaluated by the same number 
of qualified judges as here used and nave a second person grade them, using 
the guides of the judges. The correlation between tne grades of the pupils in 
this second vocabulary test and their grades in the teat here given, gives the 
reliability coefficient of the grading as a measure of the trait in question, based 
upon such a limited sampling as that here used. 

Another method is to treat the halves of the present test as separate vocab- 
ulary tests and calculate the correlation between them. This Latter method 
has been used for the history jrading, giving a correlation of .620, derived 
from a sample of 36 pupils. 'Hie English and mathematics data are not so 
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extamve, so that the oorrelatkm in those cases would be somewhat smaller. 
Since the correlation between the nadin^i of the halves of the history wonts 
equals .620, the extent to which the two halves combined, or the whole test, 

would oorrdate with a similar test, is given by the usual formula : — ; 7:- • 

H-(n-l)r 

This vahie equals .765, which is the reliability coefficient of the data as a 
measure of the pupil's vocabulary of historical words (this is, of course, before 
multiplication by the factor of accuracy). 

Dividing the words used in detemuning the factor of accuracy, into two 
parts, one part consisting of words a, b, c, d, e^ m and the other part of the 
balance, anid proceeding m a similar manner, it is found that the reliability of 
the obtained factor of accuracy equals .453. The smaDness of this reliability 
coefficient shows the limitation of the vocabulary test used, while the fact that 
the present test is si^;nificant, as will be shown later, demonstrates that a more 
accurate determination of the factor of accuracy would result in a vocabulary 

test of greater and very substantial value. Using the formula r — — 

l+(n— l)r 

the reliability of a test, based upon anv given number of words, may be ob- 
tained, and for certain numbers it is as follows: 

Question similar to No. 9, except 
that number of words » 

124 

186 

76 

Question similar to No. 10, except 
that number of words » 

26 .624 

39 .713 

52 .768 

24 .60 

37 .70 

63 .80 



In which ease the coefficient of 
reliability" 

.867 
.907 
.80 



It is apparent from these data that the determination of the factor of accu- 
racy should be based wm about three times as many words as have been 
used, to make its reliaoility about the same as the grading of the history 
words. 
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Grade for Entire Interest Test 

Mathematics: 

The combination of the mathematics grades for the various 
questions into a single grade for the test, designated as M^ is 
as follows: 

Mi-2(.2M8pti+.05MB,ti+.4Mvoc.+1.0F of A+.08MwJ. 

The factor 2 is introduced to secure a better distribution. 
^8i»tt ^ grade of the sports for their mathematical significance» 
and similarly for other designations.^ 

English: 

The single grade of the test for English is as follows: 

Ei = .2 E8pui+ .05 EB.ti+ .4 Evoo, - 5.0 F of A + .08 Ewdi+3.3 Eii^ 
+.165EBicg. 

History: 

The single grade of the test for history is as follows: 

Hi = .2H8pti+.05HBati+.4Hvo«-2.0F of A+.08Hwdi+3.3Hii^ 
-|-.165HBki* 

Sample grading of the interest test: 

The occasions for the exercise of judgment in this test are so few that a very 
few illustrationB will suffice to make the method dear. To avoid dedmals in 
the samples that follow. 5 times the measures contributing to Mi and 10 times 
those contributing to m and Hi are calculated. 



1 See Appx., pp. 101-103. 
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NameCPupUNo.go). 

Maqaiineb Ckeckxd in QcnmoN I 
X American . 


G 
Sa 

M 


Da 

BADE 
MX 

E 
5 

10 



S 
28 

4 

4 

5 
30 

9 

3 

3 

3 

5 

4 



4 

4 

6 

4 

3 

4 

4 

3 

1 

5 
1 
5 
1 
50 

3 
2 
4 
2 
2 

5 
48 
4 
3 
3 
7 
3 
2 
2 
4 
6 
5 
7 


te.. 

OF 

H 
5 
4 

2 

16 
7 
2 

6 

4 

1 
2 
5 
2 

5 
6 
3 
7 
2 
1 
7 
1 
2 
7 
4 


1 
90 

I 

2 

1 

1 

8 
8 

2 
3 
3 


3 

S 
2 

s 


Fa 

TR 

Mi 


Ei 


3oN- 

E 

Hi 






X Blue Book 








D Century (4) 

X ColUer^ Weekly 








C Craftaman (6) 












X Etude 












X Green Book 








X HBTper'o Weekly 




X Harper's Monthly 




















XLife 












X McCIure'B 












V M.m.y- 




x§sr-*".'' 








E Popular Mechanics (2) 












X Review of Reviewa 

B St. Nicholas (8) 




xscience ... rr^. !?■.:: :.:::::::.:: 
















X strand 












X World's Wotk 
















Frequency- <75) 




336 
4.6 


246 
3.3 




149 




33 times average grade 


109 
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Anatrer to questioii 2; 

" The Nayona] Geographic Magaiine is in tereeting becauBc 
it telb 10 many interestiaK things of people we know very 
little, and of plaoea none oTus have seen." 

No warrant is found in this answer for altering the grodi 
assigned to the National Geographic MagaKinc. 
Answer to question 



—Faerie Queene 

2. Scott'a— The Abbot 

3. Poe's— Fall of the House of Usher . . 



1.66 times average grade 

Answer to question 4: 

"In a long walk through the woods." . 
Answer to question 6: 



fVequency 

Avo-age grade 

2 tintcB average grade 

Answer to question 7: 

"A" Grand Opera 

.5 times the grade 

Answer to question 8? 

Ist choice: "Landscape Architect. . 



FVequency 

Average grade 

4 times average grade . . 



Answer to question 9: 



Srimary election 
f ason and Dixon's line . . 

creed 

Acropolis 

ripsaw 



compound interest. . 

cube root 

paradox 

Saracens 

I. W.W 

Whigs 

theoBophy 

toga 

block plane 

NaQ 





l.-i 




W 


f 


f 


9 


27 


« 


30 




f 


« 


•JTi 


« 


■i 


6 


27 




3 
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Word 

equ&tioo 

guillotine 

■yndiodiBm 

Bfi 

transubatAntiklioD 

gladiator 

deUtT 

giavity ceU 

rtraU 

impnqwr fnetion 

ngtioM 

phjaiiAl T&lutttion vi R.R. 

econt (in muaio) 

commerciAl fertiJiier 

Magna ChartA 

voucher 

otim 

atrins hftlt 

fourto dimensiou 

piBtan rod. . . 
Pythagorean 
single tax 

hemstitch 

Spanish Annada 

statute of limitatitus. 

rertdwate 

parallelognm 

omelette 

Reichstag 

Commerce Court 

sUte«-^Bh,. 

^^te.. '.'.'.'. --.-'.'. 

Australian ballot 

mollusk 

perapective 

nrelcss cocJcer 

mortgagee 

referendum 

Formosa 

Total 

F. of A. (obtained in next question) 

^7xtotal 

.8 times the grade 



21 


S 
15 


27 
15 


16 


6 
6 


g 

15 
3 


9 


3 


3 
12 


9 


6 


30 
3 


21 




18 




e 


30 
15 


18 




18 
24 


3 


3 


3 


« 




3 
15 
12 


144 


96 


426 


82 


» 


243 



Speciid Teats arid Their Significanee 
Answer to queatiOD 10: 



DefinitioDB (A terms; 

I. Bimile 

>. oubenofWhenKnumberUmultiplied 

bj itself three timea." 

!. improper fmctimi 

t. rag-time — "music that is ueed in ( 

and Taudeville." 

!. phyaical vsliution of nuboada . . . 

\. commercial fertiliser — "Fertiliser that 

is used in a commercial way." . . 

I. Pythagorean propodtion 

i. single tax 

. hemstitch — "In sewing when threads 
are drawn out and then i or i 
drawn together in the centre." . , 

:. vertebrate — "The small p&rta that 
make up the back bone." 

I. parallelwam — "A figure where oppo- 
site sides are pajallel." 

1. omelette — " A dnh made from eggs." 



Factor of accuracy iB^m 57 

27 

10X.57 

-BOX. 57 

-20X.57 



Mi+mean (mean in question- 16). . 
Ei+mean { " " " - 15) . , 
H+mean ( " " " =22). 

orMi-4 
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Name (Pupil No. 14). 



Quefltion I. 

Combination of all the 
that one maiked "A.". . . 
A, Life (See questioo 2) . . . 



except 

.(66) 
(10) 



Average grade 

33 X average grade 

QueBUon2. 

"I enjoy it because it is humorous and has some very 
teresting commentB on the important things which are at- 
toacting attention." 

Tlie mterest here shown in current events wairants the in- 
ereaae in the history mding of Life, bo, for this individual, 
the magaaise is graded 3 for histoiy instead of I. 
Queations 3-g. 
Bum of ttie grades for questions 3 to 9 inclusive 



special Tttis and Thnr Signifieanee 
Queation 10: 

Trame and definitionB of aame 



ft. Bimile "A nmile is a certain kind of a 

sentence." 

b. ci^>e root — "I can't explain." 

0. iiiiproperfractioD—"iBa fraction which 

u not proper." 

d. ragtime — "A form of music with 

special time." 

e. physical valuation of railroads — "Know 

nothing about it." 

f. commercial fertiliier — "Know natfaing 

about it." 

g. ohm — "Can't explain." 

n. Pythagorean proposition 

i. single tax — "A tax on your personal be- 
longings." . . 

1. hemsQtcS— "A certain kiiid trf stitch. 

Can't explain." 

k. vertebrate—-" Know nothing about it." 
1. paralleloKram — "A figure. I can't ex- 



FactOT of accuracy- .66 

10X.66 

-MX.66 

-20X.66 



Grade for 
same^pven 



Pupil 
1 



Grader 
1.5 



Mi+mean (mean in question — 18) == 
£4 +mean (mean in question = IT) = 
Hi -i-mean (mean in question = 26) = 
r Ui 6 
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(Pttpg3fa. m>. 



of the factor of accuracy only: 
Date 



ff 



A nnantity multiplied by itaelf tken into 

^ I. ■ . . - • ^A ^^ n 



d. 

e, 

f. 

i: 



1. 

• 

J. 
k. 

L 

m. 




GsA]« FOB Sams 

GlYBV BT 



"A fraction wlioae nmiHTator ii 
tban its denomiiiator." 



pliyscal TafaiatioD of railroads — ^"Actual vafaie of 
material and eonstructioo." 

commercial fertiliser 

ohm — **A certain degree to which magnets are wound. 

Pythagorean proposition — "Propontioo di s uw e i c d 
by Pythagoras regarding squares over the sides of 
rectangular trianpe." 

single tax — "Tax on land only." 

hemstitch — "An opoi kind of stitch used in sewing.^ 

▼ertebrate — "An animal having a skeleton." 

parallelogram — "A figure having two pairs of paralirf 
sides." 

omelette — "A preparation made with milk and eggs." 

Factor of accuracy =33/32 = 1.03 



Ptapfl 

3 



1 
3 



3 

3 



3 
2 
3 
3 

3 
3 



32 



3 

3 

3 
1 

3 

2 



3 
3 
3 
3 

3 
3 



33 



The grading of this interest test is not as long or diflScuH a 
task as it might at first seem. It can be greatly expedited by 
grading one question at a time after having memorised the table 
pertaining to that question, except the table for books, which it is 
impracticable to attempt to memorise. The use which is made 
of the interest test grades as well as the grades of the other tests, 
is given in the following section. 




Combination of Grades of Various Tests for Purposes 

OF Prognosis 

Taking the grading of all the tests, there are six measures for 
each individual as follows: M|, mathematics test, which is 
either the algebra or the geometry test; Et, English test; H^ 
history test; Mj, Mathematics interest test; E|, E^nglish interest 
test; and Hi, history interest test. Not only do the gradings of 
each of these tests have significance in connection with the sub- 
ject for which they are specifically graded, but they also have 
some significance for other courses. In other words, the most 
probable first-year grade in EInglish may be said to be a function 
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of Mt, Et, Ht, Ml, Ei, Hi. The regression equation, expressing 
E as a function of these six variables, might be calculated, but 
the labor would be very great, and therefore a slightly different 
method has been used, probably with little loss in the degree of 
correlation. The regression equation expressing E as a function 
of Mt, Ek, and Ht, is calculated, and this particular function is 
called Eet (meaning the measure that represents that combina- 
tion of the tests Mt, Et and Ht, which correlates the most highly 
with English). A second regression equation expressing E as a 
function of Mi, Ei and Hi, is also calculated and designated as 
Eei (meiM^iing the measure which represents that combination of 
the interest tests Mi, Ei and Hi, which correlates most highly 
with English). Finally a regression equation is calculated ex- 
pressing E as a function of Eet &nd Eeb and this function is 
designated as Ee (meaning the measure which represents that 
combination of Eet and Ees which correlates the most highly 
with English). So far as English is concerned, the entire object 
of the tests has been the derivation of this measure, Ee; and the 
correlation between E and Ee establishes the extent to which 
grades in the tests given serve as a basis for the prognosis of 
ability in high school English. The same procedure is followed 
with reference to mathematics and history, leading to measures 
Me and Hq. The following sections will be devoted to explaining 
the derivation of Met, Eet, Het, Meb Eei, Hei, Me, Ee and He, in 
the order named. 

Met — Combination of Tests with Reference to (a) Algebra 

and (6) Geometry 

(a) Algebra: In order that it may not be lost sight of, it is 
repeated here that all of the measures mentioned in the last 
section are measures that are expressed as deviations from the 
means of the groups to which the measures belong. For one 
duplicating this test, the means given on page 68 may be assumed, 
or better, they may be calculated anew for the group tested. 

The combination Act, of At, Et, Ht, which correlates the 
highest with A is as follows:^ 

Aet = .6At+.4Et+.llHt 
This equation is self explanatory. To obtain Aet it is only 
^ See Appx,, p. 99. 
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necessary to add .6 of At, .4 of Et and .11 of Ht, paying proper 
attention to sign. The correlation between A and A^t equals .48. 
The apparent weighting of the three tests, .6, .4, .11 is not the 
exact weighting of the tests, for the standard deviations affect 
these regression coefficients. Since the standard deviation of 
Hi is large the weighting is somewhat greater than .11. The 
weighting seems very reasonable, bearing in mind that Ht is 
not as reliable a measure as Et as it has but a single measure 
entering into it, whereas Et is an average of three. 

(b) Geometry: The regression equation for geometry is: 

Get=.8Gt+.08Et+.184Ht 

The correlation between G and Get equals .43. The small 
weighting of Et is somewhat of a surprise. It must be assumed 
that some of the elements enterii^ into the grading Et are more 
directly related to algebra than to geometry. 

The measures Aet and Get &r6 entered in the same correla- 
tion tables and designated as Met, for purposes of determining 
the relative weighting of mathematics, English and history tests.^ 

Eet — Combination of Teats with Reference to English 
That combination of Mt, Et, Ht which proved the most feasible 



is:* 



E«t=i(Mt+Et+Ht). 



The correlation between E and E^t equals .46. The weighting 
here used yields a correlation practically as high as that given 
by the regression equation but this is not an accurately deter- 
mined regression equation and it is impossible to use it for deter- 
mining the relative importance of the factors Mt, Et and Ht with 
reference to E. It may, however, be said that they do not differ 
greatly in their relative bearing upon E. 

Hot — Combination of Tests with Reference to History 

The combination for history is the same as that for English :' 

Hct=i(Mt+Et+Ht) 



• See Appx., pp. 99, 105. 

• See Appx., p. 100. 

• See Appx., p. 100. 
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No accurate analyais of the importance of the factors M^, Et and 
Ht with reference to their bearing upon history is possible from 
this datum. 



Mei — Combination of the IntereH Tests with Reference to 

Mat?iematics 

The regression equation giving that combination of Mi, Ef 
and Hi which correlates the highest with M is: 

Mei = .5Mi+.65Ei-.2Hi 

The correlation between M and M^i equals .30. The mathe- 
matics interest test is weighted the most heavily in this equation 
in spite of the fact that the coefficient of E-, is the largest. This 
comes about from the fact that the standard deviation of Et is 
considerably smaller than that of Mf. The actual weighting 
of the different elements is approximately in the ratio of 224: 
183 : — 95. The occasion of the negative weighting of the history 
interest test may be determined from the raw data for the calcu- 
lation of the regression equation given in the Appendix.^ In 
brief it is due to the low correlation between M and Hi, .15, 
and the high correlations between Mj and Hi, .54, and between 
Ei and Hi, .63. Why the first of these three correlations is low 
and the second and third high is not apparent — an accurate 
calculation of the regression equation involving the parts of the 
interest test would reveal the cause, but it would be a very labo- 
rious task. 

Eo — Combination of the Interest Tests vrith Reference to Engiish 

The regression equation giving that combination of Mi, Ei, 
and Hi which correlates the highest with E was found to have 
only a trifling advantage over the use of Ei alone.* 
Therefore the relation used is: 

Eei = Ei 

The correlation between E and E^ equals .46. 



1 See Appx., pp. 103-104. 
' See Appx.y p. 104. 
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Hoi — Combination of Interest Teats with Reference to History 

The regression equation giving that combination of Mi^ Ei, 
and Hi which correlates the highest with history is:^ 

Hoi= -.5Mi+.38Ei+.7Hi 

The correlation between H and H^ equals .33. The negative 
weighting of Hi in its bearing upon mathematics is comparable 
to the negative weighting here^ of Mi in its bearing upon history. 
The data for definitely determining the cause of this latter, as 
well as the former, are lacking. 

Mo — Combination of M^ and M^ with Reference to Mathematics 

The regression equation giving that combination of Moi and 
Mot which correlates the highest with mathematics is:* 

Mo = .66Moi+1.00Mot 

The correlation between M and Mo differs somewhat for the 
pupils taking geometry from that for the algebra pupils. The 
correlations are: rQG^ = .44, rAA^ = .49. These correlations are 

not as high as could be desired, nor as high as the correlation 
between grammar grade mathematics and first year mathematics, 
which is .58. However, rjj^ is only .09 less than rPMa».6.4M)> 
and when it is considered that the former is a correlation based 
upon tests of a few hours duration while the latter is based upon 
the work of four years, it is a very satisfactory showing and is of 
positive value for purposes of prognosis and classification. 

Lacking information as to the pupil's past performance, classi- 
fication, at present, usually depends upon such things as the 
pupil's,|*or teacher's, preference as to the hour when the subject 
is to be taken, or upon the first letter of his last name, or some 
other equally irrelevant point. It is earnestly hoped that tests 
will be devised enabling a very accurate prognosis, but, pending 
such tests, there is nothing to lose and everything to gain by the 
use of the tests here given, whose significance has been accurately 
evaluated upon the basis of the performance of some 235 pupils. 
A simimarized statement of the procedure in using the test data 
is given on page 68. 



* See Appx., pp. 104-106. 

* See Appx., p. 105. 
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Ee — Combination of £« and Eot with Reference to English 

E<A and Eet have equal significance in determining the most 
probable standing in English. The regression equation is: 

Eo = Eci+Eot 

The correlation between E and Eo is equal to .55. This correla- 
tion is higher than the correlation just above, for mathematics, 
though considerabley less than 7*72(7.8.5,42^1 which equals .71. 

It is interesting to note that whether dealing with grammar 
school grades or with special tests it is possible to give a closer 
estimate of a pupil's performance in English than it is in mathe- 
matics. The greater difference between the natures of algebra 
and arithmetic, than between high school English and elementary 
school English, is probably a contributing cause in the case of 
these special tests as well as in the case of elementary school 
records. 

Ho — Combination of B,^ and Het with Reference to History 

The regression equation giving the best combination of H^i 
and Het with reference to history is: 

Hc = .4Hji+Het 

The correlation between H and Hq equals .49. The apparent 
unimportance of B,^ in comparison with H^t exists only in part, 
as the standard deviation of H^i is much larger than that of H^t^ 
The actual relative weighting of Hgi and Het is approximately 
in the ratio of 22:39. 

Use of Regression Equations 

Substitution of the test grades in the regression equations is 
required in order to use them for purposes of estimation of prob- 
able high school standing in the subjects, algebra, geometry, 
English and history. After having given and graded the tests 
for the pupil whom it is desired to examine the grades are sub- 
stituted in the equation giving Ae, for purposes of estimation of 
his probable standing in freshman algebra, in the equation giving 
Ee, for estimation of his probable English standing, etc. The 
necessary equations are here summarized: 
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■.33Mi+.44E,-.132Hi+.8A,+.4E,+.llH, 
. .33M| + .«E,-.132H, + .8G,+ J!eE, 



M,-A,orG,. 

A,-.66Mi+M«- 

G. - .66M, + M„ 
+ .184 H,. 

]S,.Ei+E,-Ei+J(M,+E,+HJ. 

H,-.4H<+H,--.2M,+.16E,+ .28H,+J(M,+ E,+H0. 

Mi-Ai or Gi-.5Mi+.65Ei-.2H|. 

E^-E,. 

Hi- -.5Mi+.38E,+.7Hi 

Mrt-A« or Grt. 

A„-.6A,+.4E,+ .11H,. 

G„-..8G,+.08E,+.184H,. 

E„-J(M,+E,+ HJ. 

H„-E„. 

M,-AiorGi-i(2Ms„+.5Mt.+4M,„+10Fot A+.8M,i 
— mean). 

E,..l(2E,„+.5Es„+4E,„-50F of A + .8E,j,+ 33Eii» 
+ 1.65EBta-mean). 

H,-.l(2He,«+.5Ht.+ 4HT„-20F of A + 8Et^+33Eii. 
+ 1.65EBta-mean). 

M,-A,orG,. 

At = J(Sum of grades of all the problems— mean). 

Gt = i{Sum of grades of problems 1, 7, 8, 9. 10 — mean). 

E,-l(E,+E,+W-mean). 

H, = 2(H,-mean). 

To obtain any of the last eight grades subtract the mean from 
the pupil's gross mark and divide the remainder by the divisor 
given in the equations and repeated in the following table of 
means and divisoia. 
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If A represents the most probable algebra grade expressed aa 
a deviation from the mean, for some given numerical system of 



«^A 



<fk 



marking it is related to A^ as follows : A * Taa. -^ Ac = A9 

•ai, 3.736 

in which Ae is given for each pupil by the tests and ai is to be 

determined for the school in question. If the gprading is on a 

percentile scale with a passing mark of 70, a^ will be in the neigb^ 

borhood of 8. The following are the standard deviations of the 

type aj^. 

(TA^ ==3.736; <ro^ = 4.066; <rB^ = 6.328; flrH^«3.622. 

If G, £, and H have similar meanings to A, their values are aa 
follows: 

G = .44-^^Ge; E = .66-?^Ee; H = .49-?^H,. 



4.066 



5.328 



3.622 



The calculation may be presented as follows: 



Gross Grade of 
Pupil GboupS 

A]g. test 71 

Eng. test 22.5 
Hist, test 9 

Math. int. test 68 

Eng. int. test 153 

Hist. int. test 141 





Devia- 




Means 


tions FROM 


Divisors 




Mean 




72 


-1 


5 


15 


7.5 


3/2 


6 


3 


1/2 


65 


3 


5 


160 


-7 


10 


200 


-59 


10 



Dbviationb 

-i-DlVI80B8 

0«"Aior Mi 

5-E« 

6-Ht 

l*>Aior Mi 
-1-Ei 
-6-Hi 



Substitution of these values in equations M^, Ee, He gives 
Ac =4, Ec=3, He =2. If these measures are divided by their 
respective standard deviations (<rA^= 3.736, <rB^= 5.328, an^ — 

3.622), the resulting measures, 1.070, .563, .552, express the 
predicted standing in terms of the standard deviation. 

The calculation carried through is typical, being in fact that of 
pupil No. 157, and it is to be noted that the prediction is quite 
selective, for the estimate for algebra, 1.070, is one-half a standard 
deviation larger than the prediction for English. The advan- 
tage of such a differential prognosis over one of average ability 
only is very evident, if classification of the pupil is the aim. 
The extent to which the method performs this differential 
diagnosis may be measured by taking the differences between 
measures such as 1.070 and .563 and correlating them with the 
actual differences in grades in mathematics and English oourseSy 
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SECTION 6.— USE OF ALL SOURCES OF DATA IN 
ESTIMATING PROBABLE AVERAGE STANDING 

Of the group of pupils whose elementary school records were 
available 33 were entering first year of high school. All of the 
following data were available with reference to these 33: (1) 
average first-year grade. Fa; (2) elementary school grade (7, 6, 6, 
^a); (3) teachers' estimates, Estx; (4) special tests Mq, Eq, and 
Hq. The special tests are arbitrarily combined into a single 
measure by averaging, 

A/f -i-F. 4.TT 

=T, 



Me+Ee+Hc _ 



To determine the total bearing of these four sources of data 
upon average first-year standing the regression equation com- 
bining them with reference to it has been calculated from the 
data in the accompanying table. 

It is to be noticed that here Fa (7, 6, 6, 4a) EstA 

rFa.6.M,)-.83>.789 (given (7,6,6,4a) .83 

QN ^ *u * EstA .81 .68 

on p. 8), and that r^js^^^ ^^ 5^ ^ ^ 

.81 > .76 = rAT(l.a..'Cow..Emo.i.. Exp.). 

(Given on p. 16). These differences are probably entirely 
accounted for by fluctuations due to sampling. The smaller 
values are the more reliable, being based upon larger populations. 
The regression equation is ^ 

Fa*. 536 (7, 6, 5, 4a) +.481 EstA-. 043 Ta. 

The negative regression coefficient, — .043, is probably due to 
fluctuations in sampling. The probable error of the partial 
correlation coefficient entering into this regression coefficient is 
.112, so that no great significance can be attached to its negative 
value. 

^Fja 6. 5, 4 )jSM Tj = '89, with a probable error of .033. 

This very high correlation is of interest in showing the great 
stability of individual character. To know that a puplil's grades 

' See Appx., p. 106. 
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in the first yeax of the high school are so largely determined by 
what he possesses within his own personality is convincing 
evidence of the paramount importance of nature over and above 
nurture. With the undoubtedly varying environments under 
which these pujHls lived there would be a greater divergence 
between estimate and accomplishment if nurture were the major 
factor. 

There is a liketihood that the correlation of .89 is higher than 
might be ordinarily expected from similar data^ for^ as noted, 
the particular sample dealt with seems to show a slightly closer 
relation than usual. This is true to the greatest extent in the 
case of teachers' estimates, where it is likely that the teachers 
who made the estimates were particularly well acquainted with 
the pupils, for these pupils had been in the elementary depart- 
ment of the same school for the preceding four years, and their 
capacities for accomplishment were probably very well known. 
The lack of absolute independence between teachers' estimates 
and average class standing, noted on page 15, is a factor to be 
borne in mind. 

In case it is essential to obtain as close an estimate as possible 
of a pupil's ability all three sources of data could profitably be 
used, but for ordinary needs of classification one source should 
be adequate. The method of combining the three measures into 
a single measiire is given in the Appendix, p. 106. 



SECTION 7.— THE AGE OF PUPILS AS A FACTOR 

The number of factors involved in this study has been so 
great that the age factor has been omitted. 

The correlation between average class standing and age, using 
all the data, is —.31. Eliminating the bearing of innate mental 
capacity (or mental capacity as existing at one certain age) 
would certainly give a positive partial correlation between age 
and standing in a given grade. Though it is a fact that the aver- 
age twelve-year-old first-year pupil has a higher average standing 
than the average sixteen-year-old first-year pupil, it of course is 
not true that the average twelve-year-old is brighter than the 
average sixteen-year-old. 

The occasion of the negative total correlation, —.31, is prob- 
ably due to the fact that dull and over-age pupils are advanced 
more rapidly than their talents warrant, thereby always keeping 
them in a class which taxes their capacities and in which they 
can secure only low marks. 

Since there exists this negative correlation between age and 
average standing in a given grade, the use as a measure of in- 
telligence, of the age at which a pupil reaches a certain grade, 
gives to the bright pupil but part of the credit due him. The 
bright pupil is less advanced, and the dull pupil more advanced, 
judged by the grade attended, than talent warrants. The 
effect of this is to make the measure ''age of attaining a certain 
grade " less reliable as a measure of ability than it otherwise would 
be. 



73 



SECTION 8.— COMPARISON WITH OTHER STUDIES 

The most fundamental distinction between this and the great 
majority of correlation studies is that the aim of this study is 
prognosis and not at all to establish the existence and magnitude 
of some theoretical relationship. This fact has already be^i 
referred to but is mentioned again as some important points of 
method depend upon it. It will be noted that, in the following 
paragraphs, where comparison with other investigations of 
mental relationships is impossible, it is generally due to difference 
in method, necessitated by this difference in purpose. 

A number of investigations, notably several by Spearman and 
his pupils, have as their object the determination of the abstract 
relationship which exists between certain tests and mental 
capacities. The aim is to establish the relationship that exists 
after errors of sampling, observation, and the like have been 
eliminated. The direct conclusions from such studies are of 
necessity theoretical, whatever may be the indirect practical 
implications resulting therefrom. Acting upon these implica- 
tions educational practice might be altered, but it still would 
remain to be seen if it were bettered thereby. 

This is not a criticism of theoretical investigations for, by 
suggesting relationships and methods, they have been the fore- 
runners of progress; but it is for the purpose of pointing out the 
difference in object and the consequent difference in method 
between such investigations and the present one, which has as 
its object the utilizing of measures obtainable under ordinary 
class-room conditions, with whatever errors may be inevitable, 
for whatever they actually demonstrate themselves to be worth 
as evidence of the capacity it is desired to measure. 

If one set of test measures correlates with class standing to a 
certain extent, no amount of superimposed treatment for elimi- 
nation of observational errors, chance errors, or the like can 
change this raw relation which exists. Correction for atten- 
uation would lessen the accuracy and vitiate the significance of 
the use of marks as a prognosis of other ''raw" marks. Knowing 
the correlation between tests and average standing and wishing 
74 
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to estimate the latter from the former, the moet reasonable 
prediction is that given by the r^ression equation. This is 
exactly what the regression equation has been devised to give, 
and ''correction" of the correlation coefficients in any way at all 
would lead to less accurate estimation. For this reason, none 
of the studies, the conclusions of which are based upon ''cor- 
rected" coefficients of correlation, are comparable with this work, 
nor should the size of the coefficients of correlation here obtained 
be compared to "corrected" coefficients. The latter are meant 
to be a prophecy of what would be the correlation provided errors 
of various kinds were absent, while the former state the relation 
between existent measures. 

The results of this study, however, do shed some light, and 
give a method of attack, upon the problem of the existence, or 
non-existence, of a single mental function which is paramount 
in all intellectual activities, f The statement of the view of those 
holding to the idea of a single mental function has undergone 
much development and elaboration, until it now seems to be 
about as follows: — that every intellectual performance depends 
not only upon a general factor, "but also in varying degrees upon 
a factor specific to itself and of very similar performances."^ 

How the most ardent advocate of the specific nature of ability 
can object to such a statement, is hard to see. The problem 
is no longer a qualitative but a quantitative one. It is now 
necessary to measure intellectual performances and ascertain 
what part of each is a common element and what part is unique. 
The r^ression equation method, involving more than two vari- 
ables, is beautifully adapted to solving this problem, and corre- 
lation between differences in accomplishment, or capacity, gives 
first-hand testimony as to the uniqueness or generality of mental 
function. 

Pupils in the elementary school demonstrate a unique ability 
along the line of mathematics or English, by getting, relative to 
their average accomplishment, higher or lower marks in these 
subjects. That these marks do represent a unique ability and 
are not due to chance and the vicissitudes of teachers' grading?, 
is evidenced by the fact that different teachers, in the high 



^ See B. Hart and C. Speannan, General Ability. Its Existence and Nature, 
British Journal of Psychoiogy, 1912. Also C. Spearman, Theory of Two 
Factors, Psych. Rev,, Vol. 21, No. 2. 
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fcbool, recognize the same rebitive superiority or inferiority in 
tlie one subject, or other. The correlation r(f^.s)(7,i^s,4a«)^.52y 
with a prc^ble error of .065. The size of the probable error 
predudes the poesibility of the corrdation being due to chance. 
The attemative is that intellectual function is specific, unlesa it 
is argued that ability to secure grades is not solely an intellee- 
tual function. 

This nug^t be mamtained, but grades have been used by 
propcments of the gieneral factor theory as measures of intellect; 
and, furthermore, if so fundamental a mental characteristic as 
the ability to earn grades is not a fit capacity tar consideratioii 
in connection with the general factor theory, then the tiieoiy 
must be of very limited scope in its appUcation, and the traits of 
importance for scholastic and business success will lie outside 
its realm. The same conclusion may be drawn just as con- 
vincingly from the correlation r(]|-B)riie-Bc» = -31, for its pro- 
bable error is only .040. 

Another requirement of method is that the means used in the 
study shall be capable of determination at the time of prognosis. 
Studies which have dealt with the correlation between high school 
and university marks, or between elementary school and high 
school marks, have, without exception so far as the autiior is 
aware, selected the group upon the basis of attendance in the 
higher school, and then calculated the means in the lower school 
of the group thus selected. It fc^ows that the means used for 
the lower school data are not capable of determination until the 
selection has occurred upon the basis of attendance in the higher 
school. Any elimination that takes place is entirely obscured 
by the method, and the use of the correlation found, for purposes 
of prediction, is not sound because it is not known from what 
mean, deviations should be measured. 

However, though theoretically justified this criticism is prob- 
ably not of very great moment when dealing with elementary 
school and first-year high school pupils. The evidence of this 
study is that there is not a sufficient selection of the brighter 
pupils in passing from the elementary school to the high school 
to necessitate changing the elementary school mean of pupils 
who attended high school from the mean of elementary school 
pupils in general. It is quite possible that this would not be 
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true in schools where there is a greater elimination than in the 
well-to-do schools from which these data are obtained. 

The study of Dearborn^ is excellent evidence that high school 
efficiency is highly correlated with university proficiency, but 
the method is not a serviceable one for a quantitative prognosis 
problem; and the high school means in his distributions are 
means of high school pupils who later attended college and are 
therefore the means of a selected group. 

The same remark may be made in regard to the means used 
in the study by Miles' and it may be a material point in this 
case, for the amount of elimination between the elementary 
school and the fourth year of the high school is very much more 
extensive, and probably also selective, than between the elemen- 
tary school and the first year of the high school. Miles finds 
that the correlation between the average elementary 8cho<4 
grade and the average high school grade is .71. This is quite in 
harmony with the results of the present study and it is probable 
that Miles' data, treated by the regression equation method, 
would yield correlations between .80 and .90. 

The fact that Miles deals with the average of all high Bchoot 
grades results in higher, or lower, correlations than would be 
obtained in dealing with first-year high school marks only, 
dependent upon which of the two following factors is the stronger: 
(1) In general, as the time between testing is increased the 
correlation decreases; and as the second, third and fourth years 
of the high school are more and more remote from the elementary 
school in time, it might be expected that correlation between the 
elementary school record and the first-year record would be 
greater than that between the elementary school record and the 
average of the entire high school record. (2) A factor tending 
to offset this is the fact that the reliability of an average increases 
as the number of grades entering into it increases, and, to the 
extent that a grade represents native ability, the greater the 
niunber of grades averaged the greater the reliability of this 
measure. It is impossible to say, a prioriy which of these factors 
is the more important, but it is the author's opinion that the 



^See Dearborn, W. F.. Relative Standing of Pupils in the Hi|^ Sdiool and 
in the Univeraity, Wis, Univ. Bulletin, No. 312, 1909. 

*See Miles, W. R., Compuison of Elementary and High School Grades, 
Univ, of la. Studies in Education, Vol. 1. No. 1. 
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M,.A,orG.. 

A.-.66Md+Ma-.33Mi+.44Ei-.132Hi+.6A,+ .4E,+ .llH, 

G, - .66Mi + M., - .33M, + .44E, - .132 H, + .80,+ .08E, 
+.184 H,. 

E.-Ei+E,-Ei+4(M,+E,+H0. 

H.-.4Hi+Ha--.2Mi+.16E,+ .28Hi+j(M,+E,+H0. 

Mi-As or Gi-.5M,+.65E,-.2Hi. 

Ei-E,. 

Hi--.5M,+.38E,+.7H, 

Mrt=A« or G* 

A,-.6A,+ .4E,+.11H,. 

G„-.8G,+.08E,+ .184H,. 

E„.1(M,+E,+H0. 

Hrt~Ert. 

Mi-AiOrG,-K2Mj«+.5MB.„+4MT„+10Fof A+.8M,i 
—mean). 

Ei-.l(2Es,.+.5Ea.+ 4Ev„-50F of A + .8E,i+33Ea,„ 
+1.65 Eeb— mean). 

H,-.l(2Hj«+.5Ht„+4Hv„-20F ot A + 8E,j,+ 33Ea,„ 
+ 1.65EBk,-mean). 

M,-A,orGi. 

At=i(Sum of grades of all the problems— mean). 

Gt = i(Sum of grades of problems 1, 7, 8, 9, 10— mean). 

E,-j(E.+E,+W-mean). 

H,=2(H.-mean). 

To obtain any of the last eigbt grades subtract the mean from 
the pupil's gross mark and divide the remainder by the divisor 
given in the equations and repeated in the following table of 
means and divisors. 





Ma™. 


Ei«3. Hrar. 


Matb. 


Eno. 


HiBT. 




TwrMt 


TEarEt TbbtHi 


Int. Mi 


iNT.Ei 


Int. Hi 


Gkodf and 














Class 


1 


1 


1 


i 1 i 


^ 


1 


1 


i 


1 


1 






s 


O S Q 


S 




s 


Q 




1 Begiiiiiiiig2cl 






















2^yiarUt 


Ot25 


3 


18.5 


3/2 7 1/2 


95 


5 


170 


10 


260 


10 


a^toriiig'l'st 


Atsg 


5 


16 


3/2 6 1/2 


80 


5 


160 


10 


220 


10 






















4^«inmiig2d 


At72 


5 


15 


3/2 6 J/2 


65 


5 


160 


10 


200 


10 


5 Eotcriiig lat 


Ot26 


3 


19 


3/2 5.S 1/2 


100 


5 


190 


10 


280 


10 






















year 


Ai88 


S 


17 S 


3/2 fl.S 1/2 


70 


5 


170 


10 


240 


10 
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If A represents the most probable algebra grade expressed as 
a deviation from the mean, for some given numerical system of 



5A A _ 



<^A 



marking it is related to A« as follows : A = r^^ -=- Ac =* .4& ^^ A^ 

* ^A^ 3.736 

in which A^ is given for each pupil by the tests and ^a is to be 

determined for the school in question. If the grading is on a 

percentile scale with a passing mark of 70, a^ will be in the neig)^ 

borhood of 8. The following are the standard deviations of the 

type aj^. 

<rA,= 3.736; ao, = 4.066; <rB^= 5.328; <fH,» 3.622. 

If G, £, and H have similar meanings to A, their values are aa 
follows: 



G = .44 



<^G 



Ge; E = .55-^^Ee; H = .49-^^Hc. 
4.066 5.328 3.622 



The calculation may be presented as follows: 



Gross Grade of 
Pupil GbuyupS 

A]g. test 71 

Eng. test 22.5 

Hist, test 9 

Math. int. test 68 

Eng. int. test 153 

Hist. int. test 141 





Devia- 




Means 


tions FROM 
Mean 


Divisors 


72 


-1 


5 


15 


7.5 


3/2 


6 


3 


1/2 


65 


3 


5 


160 


-7 


10 


200 


-59 


10 



Dbyiations 
-hDivnoss 

O^At or Mt 

5-E« 

6-H« 

l»Ai or Mi 
-1-Ei 
-6-Hi 



Substitution of these values in equations M^, Eq, Hq gives 
Ac = 4, Eo=3, He =2. If these measures are divided by their 
respective standard deviations (<rA^ = 3.736, ff]s^^ 5.328, cu^ — 

3.622), the resulting measures, 1.070, .563, .552, express the 
predicted standing in terms of the standard deviation. 

The calculation carried through is typical, being in fact that of 
pupil No. 157, and it is to be noted that the prediction is quite 
selective, for the estimate for algebra, 1.070, is one-half a standard 
deviation larger than the prediction for English. The advan- 
tage of such a differential prognosis over one of average ability 
only is very evident, if classification of the pupil is the aim. 
The extent to which the method performs this differential 
diagnosis may be measured by taking the differences between 
measures such as 1.070 and .563 and correlating them with the 
actual differences in grades in mathematics and English courses, 
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a second, then a mass test of mental age gives no light upon the 
distinctive feature which it is desirable to be acquainted with. 
There is plentjr of evidence to indicate that deficiency is selective 
in masky cases and the defect of the Binet tests on this point 
should be remedied. However, there is sufficient oorrelatkai 
between defects to make a Binet test of considerable value for 
purposes of classification; just what value has never been deter- 
mined, so far as the author is aware, in quantitative terms, i.e., 
in terms of the correlation between capacity, as estimated from 
the test, and capacity as determined by as oomj^ete and con- 
clusive measurements as possible. It is essential that mental 
age tests be tested by such methods, in order to judge which are 
the more accurate and what their accuracy is. 

The use of tests of this nature as a guide to clasufication may 
be illustrated by the work of Adler, in New YcH-k School 77.^ 
Boys in the first and fourth grades were tested with Dr. Goddard's 
1911 revision of the Binet tests, with additions from the tests 
of Terman, Whipple and C!ourtis. In both the first and fourth 
grades the 35 pupils, out of about twice that number, who 
tested hi^est, were placed in an advanced class. The results 
were highly satisfactory. To quote the results in the case of 
the advanced section of the fourth grade: "Twenty-two of the 
thirty-five pupils are ready to begin the second half of the fifth 
grade work. Thirteen of the pupils b^in the regular fifth grade 
work, though several of these will probably catch up with the 
advanced pupils before the end of the term. One pupil, who was 
absent because of contagion, will be retarded." The tests are 
evidently of high significance, but the calculation of the coeffi- 
cient of correlati(m between them and the accomplishment in 
class would be of value in giving a quantitative measure to the 
degree of accuracy of the classification. 



*See Adler, Martha, Mental Tests as a Basis for Classification, Jour, of 
Educ. Ptydi.f Vol. V, No. 1. 



SECTION 9.— PRACTICAL APPLICATIONS IN HIGH 

SCHOOL CLASSIFICATION 

There can be little question as to which of the three sources of 
estimate of a pupil's scholastic ability is the preferable one to 
use, in case it is not desired or possible to use all of them. The 
elementary school records of the pupils give the most accurate 
estimate of average class standing, as well as of standing in 
specific courses. A higher correlation than .80 between estima- 
tion and actual first-year standing should not be demanded, or 
expected, in a correlation of this nature. 

There would be a great advantage in having a imiform record 
card, for each state school system, to contain, in addition to 
other data, the pupil's grades from year to year, together with a 
definite statement of the significance of the grades in terms of a 
normal distribution, or as deviations from the grade mean for the 
local system in question, expressed as multiples of the variability 
for that system. If these cards were freely transferred from school 
to school, as the pupil changed, it not only would be possible to 
classify pupils accurately each year, but it would be of incal- 
culable value from other standpoints as well, for there is prob- 
ably no easily obtainable data which could compare in signifi- 
cance with such a record. 

The estimates of several of the previous teachers of the pupil 
give an excellent basis for classification, but wherever available, 
the more valuable records in the elementary school are probably 
also available, so that, for high school classification, they are 
not of prime importance. 

They are, however, of specific value in analyzing the elements 
which contribute to scholastic success. In the regression equa- 
tion based upon teachers' estimates, effort shows itself to be a 
very important factor. There woiJd, therefore, be many advan- 
tages for educational, and even more particularly for vocational, 
guidance if there were available grades representing ability and 
effort, as well as accomplishment. 

The importance of the interest and specific subject tests is not 
6 81 



SECTION 10.— GUIDANCE METHODS 

It will be found that having once initiated a guidance bureau 
the demands upon it will be positive and innumerable — many of 
them extravagant. In the attempt to meet these demands, and 
to meet them on the spot and without a moment's delay, one of 
the richest sources of information is likely to be only very parti- 
ally utilized. Reference is made to that product accumulated 
by every pupil — school grades. Whatever capacity it is that a 
grade, say, in mathematics, stands for, it is measured with a 
high degree of accuracy when the records of several years and 
of several teachers are combined. A pupil's school record is the 
most complete, detailed and accurate of all records, of the 
ordinary pupil, from his entrance in school to his entrance into 
work. Unless the significance of this record is evaluated with 
reference to all the important studies and vocations the most 
readily available and accurate data concerning the applicant for 
a place in some class, or for a job, are not being utilized. The 
evaluation of these data will require much statistical work, but its 
use after evaluation is simple. 

Teachers' estimates of a pupil are second in importance only 
to grades. It requires, however, the estimates of several teachers 
to secure an accurate rating, and, under present conditions, it 
frequently is not possible to secure the estimate of more than 
one and, in cases where either the pupil or the principal changes 
location, even this is lacking. If each teacher were to place on 
record, at the end of every course, an estimate of several of the 
qualities, important for success, of each of his pupils, these data 
would be of inestimable value to the guidance expert. In this 
case, as that of school grades, a imiform record card, carrying a 
standardized grading, is essential for the best t'esults. 

The use of special tests in vocational guidance is unlimited. 
There could well be certain specialized tests for each important 
vocation, but first of all there might be devised a general test, 
somewhat along the line of the interest test in this study, which 
would have significance in all vocations and which could be 
evaluated with reference to any one desired. This general test 

84 
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could test interest and general mental capacity, while it could 
be left to the specialized tests to measure specific capacity and the 
necessary acquired knowledge. 

In so far as guidance becomes a science and not an intuition, 
in so far as its method and conclusions are capable of definition 
and free use by different individuals and are not simply inner 
convictions of the expert making them, the problem of relation- 
ship, expressed in quantitative terms, between the capacity of 
the applicant and the demands of the position will become more 
and more insistent for solution. A guidance bureau should be 
like a type distributing machine, which will take a hopperful of 
type, of all the letters of the alphabet, and place each in its partic- 
ular niche, in the one place of all places where it fits. That a 
fitting distribution of human talent is a task of unmeasured 
intricacy is apparent, but the peculiar service thereby rendered 
to groping humanity makes the solution worthy the greatest 
effort. 

In broad outline, as already pointed out, the problem of vo- 
cational guidance consists of measuring the demands of the 
possible vocations, and of the capacities of the applicant and then 
fitting the applicant into that place which best suits his talents 
and his ambitions. In detailed procedure, the regression equa- 
tion method is a powerful instrument, for it enables any niunber 
of factors to be combined with the highest significance with 
reference to the vocation in question. When a large number of 
factors, none of them of predominant importance, contribute to 
a total result, the hiunan intellect, unaided, cannot compass 
their total significance and it is only by mathematical means 
that they can be siunmed and interpreted. 



SECTION 11.— APPENDIX 
Ages of Pupils 

This study covers four different groups of pupils: (1) 59 pupils starting the 
second year of the high school of School A; (2) 42 starting the second term of 
the first year of the same school; (3) 81 starting the first term of the first year 
of the same school; (4) 26 pupils starting the second year of the high school of 
School B, and (5) 25 pupils starting the first year of the hi^ school of School 

B. Ages are expressed in years and tenths of a year from birth up to January 

1, 1913. Since the algebra and geometry tests were given during the last of 

September and the first of October, 1913, and the English, history and interest 

tests were given in January, 1913, the average ages at the times of the tests 

may be obtained from the given means by subtracting .30 of a year in the cases 

of the algebra and geometry t€sts and by adding X)5 of a year in the cases of 

the other tests. The mean ages of the different groups January 1, 1913, is as 

follows: 

Group 1 16.1 years. 

Group 2 14.6 " 

Group 3 13.7 " 

Group 4 15.7 " 

Group 5 14.4 " 

The Assignment of Numerical MAGNiruDBS fob Literal 

Grades 

In both schools a literal grading system is in use. In School A lett^s A, B » 

C, D and E are used. The mark E is used very infrequently — some teachers 
not using it at all. In avo'aging the grades for two or more terms it was 
assumed that the difference in abiUty represented by grades of A and B was 
equal to the difference in abiUty represented by grades of B and C, etc. That 
little error resulted from this assumption will be shown in the next section of 
this appendix. In averagmg the grades of four tarns the following differences 
in ability may occur: 



A+A+A+A ,, A+A+A+B 
i AJ J , 



A J , Aj J , 

-. , A+A+B+B A+A+A+C ^, , A+B+B+B 
B+« = , BJ+- -etc., 

4 4 4 

^^ B-hB+B-hB ^ A+B+B+C _^^^ 
4 4 

And so on for other combinations. The literal grades thus obtained were then 
transformed into num^cal grades, assuming a normal distribution of talent. 
This is very readily done by noting the percentage frequencies of the different 
86 
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grades and uBing such a table for transformation as that given by Thomdike 
in his '' Mental and Social Measurements/' pp. 221-225, second edition. Upon 
this basis literal grades were assigned numerical values as follows: 

Courses in which Tests Were Given at Beginning op Term 





















HiBT. 


Hist. 


Hurr. 




Alo. 


Alo. 


Gto. 


Geo. 


Eno. 


Eno. 


Eko. 


Eno. 


3rd& 
4th 
Yr. 


2nd 

Yr. 

IYr. 


lar. 




lyr. 


1 Yr. 


IYr. 


IYr. 


*Yr. 


iYR. 


iYR. 


iYR. 


Yr. 
*Yr. 




















JYr. 






Qboups 


2and3 


6 


1 


4 


1 


2 


3 


4 and 6 


1 


1 


2 


A + 






2.44 




1.99 














AJ + 
























A 


2.34 




1.42 




1.49 


2.70 


1.81 




2.23 


1.23 


1.96 


A*- 


1.69 




.99 


















B+ 


1.29 




.88 


1.56 


1.27 


1.66 


1.13 


1.49 




.66 


1.14 


B* + 


1.05 


1.92 


.77 


















B 


.80 


.96 


.61 


1.28 


.65 


.78 


.68 


.67 


1.29 


.29 


.67 


BJ- 


.67 


.44 


.23 


.92 
















c+ 


.38 


.06 


.08 


.58 


.07 


.16 


.21 


- .06 


.77 


- .06 


.28 


Ci + 


.17 


- .24 


- .08 


.15 
















c 


- .01 


- .58 


- .20 


- .36 


- .48 


- .28 


- .39 


- .70 


.32 


- .60 


- .20 


cj- 


- .24 


-1.20 


- .31 


- .71 








-1.35 








D + 


- .47 


-2.10 


- .63 


-1.00 


- .96 


- .73 


-1.13 


-1.99 


- .32 


-1.32 


- .74 


5*+ 


- .64 




- .81 


-1.42 
















D 


- .77 




-1.09 


-2.16 


-1.46 


-1.11 


-1.99 




- .88 


-2.16 


-1.33 


5*- 






-1.49 


















D- 


-1.03 




-1.89 




-1.86 


-1.34 






-1.17 






E 


-1.64 




-2.44 




-2.10 


-1.66 










-1.86 


-2.34 








-2.70 


-2.28 






-1.49 




-2.62 


E- 


















-2.23 







The same kind of transformation tables were obtained in 18 other courses 
in order to obtain numerical measures for the literal grades received in the 
first year of the high school by the 59 pupils whose records were available 
down to the third grade. The populations upon which the transformations 
were based averaged 40.4 pupils per course. 

The grades of A+ and A}+ require explanation. In mathematics and 
English special classes were formed for the particularly bright pupils. The 
grading of pupils in these classes was more severe than the ordinary grading. 
It was the opinion of the teachers concerned that grades would be comparable 
with the rest of the grades of the school if the grades received in the special 
mathematics classes were raised one point, i.e., call C's, B's and B's, A's, etc., 
and if the grades received in the special English classes were raised one-half of 
a point. This was accordingly done, and accounts for the grades A+ and 
Ai+. 

The grade D— is an average of such grades as the following: first term D, 
second term E, third term E, fourth term D. This is a passing grade for the 
year. The grade E+ is an average of the same grades, except that the final 
term is an E, constituting a failure for the year. It is reasonable to assume 
that slightly greater proficiency is shown in the former case than in the latter. 

A further simple transformation was made in order to obtain measures that 
were convenient to work with. The numerical measures obtained by use of 
the preceding transformation tables were each divided by .2 and the results 
kept to the nearest integer. The range thus obtained has about 26 divisions 
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■ k Ml tbiMwitf4 4rrMt«aii aborts. lUi 
Mtl IfM \ ^ M\^i mm of ^Irwkrira aad tfe cCaet of tfe 
■A eometM i» tW ir»lae of tJbe eocfidoMB of 
ttO0WBt rif it. TLe dflCribotkwi tboi obuoDcd ha^s 
driK spprr/oDuitM, md bo eomecioa to Uie 
w^giil^ V> orjmKt fr^ astiftnry bmhbh. 

To ua/i tiK ext^est of tbe cnor dae to tbe «^ 
fol&viDf ffteu tfe to be oooflidcnd: 




of ftoBl ^idca, the 



DO error k Jntfr>diKs«l beesoie the 011I7 wmnniiin nw oHed ii that A>B+ 
> B, etc., wfaieb if tbe bMc —uniplion uDderiyiog the tnuHfonnjuioa off 
hUrtd fsnideM into nummad gTBdei. Some 92 per eeot of the aTcngiiig ms 

ofthknfttore. It ii r^ly when it ii stjued that ^-H^^»^^^»B thai 

2 2 

there ii danf^ff of error from thii aource. Simplify i ug we find that thii equation 

ii tme only in eaae A— B*B— C. The foDowing data show to bov close aa 

extent thii aamimption ii true and it riiould be ronembered that it appfies to 

only abcwt 8 per cent of the averaging done. 





AuiBsaA-Oaorrs 


EsoLaB-GBom 


t HaioKT-Gaocp 1. 


Gwammtmr-Gmocw 




2 Am 3. Atbuob 


1.2a»3. Atbuoi 


u ATBAfiB or Tvo 


1. ArKMA-ts or 




^m - J* _ 


or Two QTAavBBi 


Aramw^a 


Two QrAavBBi 




CorrnvrnfaBC 


ComipoadiM 




cnKte: 


cnKte: 




cnKte: 


A 


1.41 


' 1.80 


1.57 


2.03 




A'B-.M 


A-B-1.04 


A-B-l.OS 


A-B-l.a 


B 


.&5 


.76 


; .50 


.81 




B-C-.71 


B-C-1.00 


B-C- .80 


B-C- .91 


C 


- .16 


- .24 


;- .28 


- .10 




C'D-.M 


C-D-1.10 


C-D- .99 


C-D- .89 


D 


-1.02 


-1.34 


-1.27 


- .99 




D-E-.93 


D-E-1.27 


D-E-1.06 


D-E-1.04 


E 


-1.95 

E-F-.88 


-2.61 


1-2.83 

1 

1 


-2.03 


F 


-2.83 




1 





From the above table: 





If A-B-1, 
thenB-C- 


If B-C-1, 
thcnC-D = 


If C-D = l, 
tbenD-E = 


If D-E = l, 
then E-F= 


Ate 

fcn« 

Hiat 

Oeom 

Ar 


.83 
.96 
.76 
.75 
.83 


1.21 
1.10 
1.24 
.98 
1.13 


1.08 
1.16 
1.07 
1.17 
1.12 


.91 



Average of all » 1.02 
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From similar tables for groups 4 and 5: 



Eng.. 

Geom, 

Av... 



If A-B-1, 
thenB-C« 



.842 

.914 

1.070 

.942 



If B-C-1, 
thenC-C-- 



.679 

1.018 

.855 

.851 



If C-C--1, 
thenC D = 



.99 

.98 
.96 



Average of all ». 9 18 



Similar data from the elementary school group show a still closer approach 
to equality. 

It is therefore plain that no appreciable error hss been introduced by such 
avoraging. 

Elbmbntart School Grades 

In the elementary school the system of grading for certain years was different 
from that for other years. In a few of the grades the literal system A, B, C, D, 
Ey Fy was used, but in the major number of grades considered the marics giveii 
werel, 2, 3, — 1 being the highest grade used. By assuming a normal distribu- 
tion, and expressing both the vahies 1, 2, 3 and A, B, C, D, E, F in terms of 
deviations from the means, the values may be compared with each other. The 
following relation exists: 









Average 








Weighted 


Engurh 


Abithmbtic 


HiSTOBT 


Relation 
(Used in all trans- 
formations.) 


AtoF lto3 








A- 1.2<r-1.0 


A« 1.8<r= .9 


A= 1.7<r- .9 


A- .9 


B- .2<r = 1.6 


B- .8<r-1.6 


B= .5«r-1.8 


B-1.6 


C=- .6<r-2.1 


C= .0«r=2.1 


C«- .5«r=2.2 


C=2.1 


D=-1.3<r=2.5 


D=- .8<r = 2.6 


D=-1.4<r=2.8 


D=2.6 


E=-1.7<r=2.7 


E=-1.6<r=3.1 


E=-2.2<r=3.3 


E=3.0 


F=-2.4<r=3.1 


F=-2.4<r=3.6 




F-3.4 



With this transformation table literal grades were expressed in units that 
are comparable with the numerical grading 1, 2, 3. The final grade given each 
year, for each pupil, in English is the sum of the grades given for the four 
terms of the school year in two English courses, e.g. ''Reading and Literature" 
and ''Composition." Thus the poorest grade possible is 24 and the best 8. 
The grades given in arithmetic and history are the sum of the grades for the 
four terms for these subjects, therefore the lowest grade possible is 12 and the 
highest 4 in each of them. 

A few of the 59 pupils in this group skipped a year. In such a case the grade 
of the year before was entered for the year skipped. This, of coiurse, would be 
a high grade and representative of the ability of the pupil. 
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In expressing the grades of these 59 pupiis as deviations from the means, the 
means of the grades in question were obtained. Random samplings of about 
40 from each of the grades for the various years were the basis for the calcula- 
tion of the means. The reason for this is apparent. Since this is a prognosis 
problem, the prognosis must be based upon the rankings of the individuals 
in the groups in which they are found. 

Several investigations have shown that there is a selective process operating 
to eliminate backward pupils from the granunar grades. Under these condi- 
tions, the 7th grade average of those who attend the high school would be 
slightly greater than the average of all 7th grade pupils, still more greatly 
above the average of all 6th grade pupils, etc. The difference would be most 
pronounced when dealing with the average grade of these pupils in the 4th 
grade. Calculation shows that this particular group of 59 pupils is .224 sigma 
above the average of first year pupils in general. Calculation also shows that 
they are .367 sigma above the average of 4th grade pupils. There is thus only 
the small difference of .143 sigma which can be attributed to selective elimina- 
tion of the weaker pupils. Taking all the elementary grades together, as 
combined by the regression equation, it is found that there is not even a 
difference of .143 sigma. In fact, these pupils who, as first year pupils, are 
.224 sigma above the average of such pupils are, as elementary pupils, only 
.186 sigma above the average of 7th to 4th grade pupils when grades are 
weighted according to the regression equation. If any conclusion is justified 
from this small population, it is that in this particular school there is no 
selective elimination of the duller pupils. 

In calculating the correlation between first year standing and the combined 
7th to 4th grade standing, no correction is made due to the means of the popula- 
tion of 59 being different from the means of the entire body of first-year high 
school pupils, or the entire body of 7th to 4th grade pupils. Due to the nature 
of the problem no correction to the first-year high school mean is permissible 
as the object of the study is to prognosticate divergence from this mean. A 
correction to the mean of the combined elementary grades might be applied 
but its magnitude would be .224 sigma —.186 sigma « .038 sigma, which is 
negligible. Even the correction to the 4th grade alone, .224 sigma —.367 
sigma » —.143 sigma, is inconsequential. 

The calculation of the regression equation giving the regression of the first- 
year high school grades upon a combination of 7th to 4th grade marks is based 
upon the following data: 

Fa 7a 6a 6a 4a 
7a .719 

6a .728 .730 

5a .531 .425 .541 

4a .624 .551 .573 .676 

<r's 3.796 4.167 4.891 6.308 6.912 

Fa=.3082 (7a)+.2407 (6a)+.0746 (5a)+.1291 (4a) 
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or approximately 1.803 (Fa) = i[l.e67 (7a) +1.3 (6a) +.4 (5a) +.7 (4a)]. This 
oombination of elementary school records is designated as (7, 6, 5, 4a), and the 
correlation, rvj^o, 6, 5, 4a) "■ -^BO. 

The same equation is used to obtain measures in elementary school mathe- 
matics and English, except that division by three is omitted, giving the follow- 
ing: 

(7, 6, 6. 4m) =1.667 (7m)+1.3 (6m)+.4 (5m)+.7 (4m) 

(7, 6, 6, 4b) = 1.667 (7b)+1.3 (6b)+.4 (5e)+.7 (4e) 
Calculation gives: 



rFM(7. «. 5. 4m) = -580 and rpgor. «, 5, 4b; = .710 



No history was taken during the first high school year so there are no history 
correlations. 

It may be noticed by reference to the preceding table that ^Fa^a ^^^ ^a'^A 
are less than would be expected from the other correlation coefficients. This 
may be due to the teachers of these particular 7th and 5th grades being less 
expert in estimating the ability of pupils than the 6th and 4th grade teachers. 
Whatever the cause, probably a better regression equation for general pur- 
poses can be obtained than the one given above. The accompan3dng curve 



r Between Grade 

IN a Given Year 

AND Grade One 

Yr. Before 



Av. of 4 coef's. 
.6415 



r Between Grade 

IN A Given Year 

AND Grade Two 

Yrs. Before 



Av. of 3 coef 8. 
.5763 



r Between Grade 

IN a Given Year 

AND Grade Three 

Yrs. Before 



Av. of 2 coef s. 
.541 



r Between Grade 

IN A Given Year 

AND Grade Four 

Yrs. Before 



I 1 coef. «.624 



64/:f 




.SO 



was drawn with this end in view. A smooth curve, not rectilinear, is drawn 
near the points representing the ordinates for the various abscissae. The 
intersections of the curve with the ordinates give the values of the correlation 
coefficients in the succeeding table. 

The falling off in correlation from year to year is thought to be reasonable 
and calculation will show that the sum of the deviations of the actual coefficients 
of correlation from the points where the curve crosses the ordinates at the 
various abscissae very nearly equals zero, so that the curve is not entirely 
arbitrary. 
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Yb. IN 

Question 




1 Yb. Be- 

rOBE 

1 


2 Tb8. Be- 

FOBS 

2 


3 Tbs. Be- 

FOBE 

3 


4TBB.B1. 

rOBB 

4 


1 

2 
3 
4 


.67 
.58 
.53 
.50 


.67 
.58 
.53 


.67 

.58 


.67 




a'a 


^9 


^ 


O'l 


^9 


#4 



The foDowing regresBbn equation is derived from the taUe: 



X,-. 4616 -Xi+. 1458 -X,+.0910-X,+ . 1098- X4 

«ri 9t 9% 94 

In case the standard deviations are all equal, this equation beooines,-to a 
dose approximation: 54.9 X« « 25 Xi +8 Xt +5X1+6X4. 



TbACHKBS' EsmfATBS AND CoilBINATrONS OF THE SaMB 

Having the estimates of several teachers of the mental traits of each papil» 
it is necessary to combine these estimates into sinfde measures of the tnit m 
question for the pupil in question. Each teacher reported on about 25 pupils 
and it is assumed that the talent follows a normal distribution. The rankingi 
of the teachers were then expressed as deviations from their respective means, 
using the same method as used in transforming literal into numerical grades. 
The number of gradingB obtained for each pupil ranges from two to seven. 
It will be seen from the following table that the correlation between these 
estimates is low: 



^(COM. 


) (eoM. 


\«».oo::t:.UAA 


^(eiD0.int. '* 


) (emo. int. *' 


)=.31±.024 


^«ip. 


) (exp. 


)-.29±.024 



Because of this, it is impossible to average these grades and have them even 
approximately comparable, for the standard deviation of the measures which 
are the averages of the grades of two judges is materiaUy greater than the 
standard deviation of the measures which are the averages of the grades d a 
greater number of judges. The extent of this difference can be readily esti- 
mated, for if Xi, Xi, ' ' • XnSie measures of the same trait, and if r is equal 
to the correlation between such measures, and if sigma Xissigma X% 
«... sigma Xnt then we have: 



'Xi+Xi 



*^ 



V 4n 



2(x,*+2a:,a:,+x,*) 



<^X 



4n 



V^ 



+r 
2 
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Similarly, 



Finally, 



<^I.+I.+I, 



'Xi+It+ • • • I, 



./H-2r 
'I.V n 



In order to make the standard deviations of measures which are averages of 
varying numbers of estimates comparable, it is only necessary to divide the 

measures by their respective sigmas, i.e., if but a single measure divide by sigma 

X 4- y 
Xi; if an average of two measures divide by sigma — s — > ^^' "^^ follow- 
ing table gives the desired divisors for the various cases:' 



No. of grades 


I. a. 


Cons. 


Emo. i. 


Exp. 


avenged 


Intellectual 


Conscientious- 


Emotional 


Expression 




ability 


nesR 


interest 




1 


.92 


.92 


.92 


.95 


2 


.74 


.79 


.74 


.76 


3 


M 


.73 


.66 


.68 


4 


.63 


.69 


.63 


.65 


5 


.61 


.67 


.61 


.63 


6 


.59 


.66 


.50 


.61 


7 


.58 


.65 


.58 


.60 



The mean num)i>er of grades averaged to obtain each individual's measure is 
about two and one-half, therefore the reliability coefficients have approxi- 
mately the following values: 

aadttiTed) G-ft. iMM.ifaiiibri3rderiTed)'».408 



rci.%. 
'^(enw. i. 



t* 



t* 



t« 



t< 



) (eiD0.i. ** 
)(«xp. - 



i« 



«« 



t« 



)-.605 


)-.505 


)".520 



In 23 eases of group 2, teachers' estimates were not available, except teachers 
of English and history who later had the same pupils in test courses, which were 
continuation courses of the first half year's work under the same teacher. 
The estimates ot such teachers were not used when it could be avoided, i.e., in 
an cases except these 23. The following correlations justify excluding such 
estimates: 

''Ofi. ».— Qitimate of seometiy teMhan) "■ '^'^ I P^P* ""^^ 
'"aa.ft.— " " other " )-.44\ group 1 

''Ba.ft.— " •• Wn giifii •• )".54 f pop.«=33 
^m,%.— " •• othor " )=.36\group2 



'This method of averaging varying numbers of correlated measures was 
used frequently in other portions of this study, e.g., m averaging grades of 
pupils for some given term or year where the number of studies varied 
appreciably. 
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• 

The estimates of "other'' teachers may be considered as accurate as those of 
the geometry or English teachers, so that the excess of .57 over .44, and of .54 
over .36 is, in a sense, a measure of the extent to which a teacher's estimate ia 
based upon the unique ability shown in the subject he teaches. 

The combination of the measures, based upon teachers' estimates, into a 
single final measure or estimate of scholastic abihty is accomplished by the 
usual regression equation, as follows: 

Av. I. a. Cons. Emo. i. Exp. 

I. a. . 72 

Cons. .62 .61 

Emo. i. .58 .61 .66 

Exp. .63 .82 .55 .59 

a's 4.048 5.193 5.166 5.138 5.190 

+ .0471?^ (Exp.) 

or Av.= . 364(1. a.) + .183 (Cons.) + .086 (Emo.i.) + .043 (Exp.) 

or, approximately, 1.1 (Av.) = . 4 (I. a.) + • 2 (Cons.) + . 1 (Emo. i.) +.05 (Exp.) 

— which is a very simple equation to use. 

""(Av.) (I. »., Com.. Emo. L, Exp.) " • 7^^^' 



Bearing of the Varioua Factors, I. a., Cone., Emo. i., and Exp., upon M, Ef 

and H. 

From the accompanying data: 
Mte."-*^^— 1»+^14— — j^ J ^ Cons. Emo. i. Exp. 

L ft. Com. 

^ I. a. . 591 



Exp. .496 .82 .55 .59 
-..014-^ Exp. ^* ^M ^L.. ^CoM. ^ftiio.l. ^bp. 

Rzp. 

''MM* " • ^1 (Population = 178). 



$rom the accompanying data: 

£4 ^ ^.000 — — 1. a. +.^0! ■ T-i •» r^ Ti • »^ 

•• •• aj^ ^ ^CoM. E I. a. Cons. Emo. 1. Exp. 

^ I. a. .598 

Cons. +.068 — 1-Emo. i. gons. , .646 .61 

<r«^ J Emo. 1. .487 .61 .66 

™*' • Exp. .536 .82 .55 .59 

+.083-^ Exp. "^'^ "^B ^I... ^CoD..^ano.i.^Bip. 

^Bxp. 

rj g « . 64 (Population = 179) 
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From the accompanying data: 

^4. ••" "^^ S^ ^' *• "'^^ 5^ H I. a. Cons. Emo. i. Exp. 

La. .381 

Cons.+.305^Emo.i. ^Zi/.^ H .66 

*^** Exp. .245 .82 .66 .69 

-.287-^ Exp. ^'® ^= ^I'- ^^"^ ^^^•*- ^""P- 

''H H* "* • 4^ (Population = 68) 



GRADmo OF THS Alobbba Tbst 

Haying the grading^ for the various problems in the algebra test, it it 
impossible to say, a priori^ with any assurance, which are the most significant 
and which are the least so. The common procedure in a case like this is to call 
them all of equal importance and add or average. Whether such a procedure 
results in getting out of the data all that is in them or not, is a fit subject for in« 
vestigation. The question is simply this — does the magnitude (grade of prob. 
1+ grade of prob. 2 • • • + grade of prob. 14) correllate as highly with the 
algebra grade received at the end of the school year, as the magnitude (Ci X grade 

of prob. l+CiXgrade of prob. 2-\ Cm Xgrade of prob. 14) where Ci, Ci, • • • 

CiA have the best values possible. Of course the second magnitude would result 
in the higher correlation, or, what amounts to the same thing, the stand- 
ard deviation of the residuals in the second case is smaller than the standard 
deviation of the residuals in the former case. Using the notation given by 
Yule, this is to say that 

^A. 1. 2. 8. 4, 5. 6, 7, 8. 9. 10. 11. 12. 18, 14 ^ ^A. l+2+8+4+6+e+7+8+»+10+ll+U+18+l4 

(A "grade in algebra course, 1 "grade of first problem, etc.) It is manifestly 
impractical to attempt to calculate c^ j , , 4 ^^ 7 g^ ^^ ^^ ^^ ^ ^ j4 but an 

approximation to this may be obtained if the problems 1, 2, • • • 14 that have 
about the same standard deviations, and that are correlated to about the same 
extent with A, and are correlated with each other to approximately an equal 
extent, are grouped, thus reducing the variables to sudi a number that the 
calculation is feasible. In attempting to fulfill these conditions, problems 1-4, 
8-11, were grouped, as were also problems 6, 13, 14, giving groups A', B\ C, 
respectively. The question then is to determine a^ a'B'C ^^^ ^Jl A'4-B'-W' 
Formulae giving these expressions (derived in the next section) are as follows: 



*^A. A+5»+C""*^ 



^ L ^^^'^^^A'^A'^B^J 





A 


A' 


B' 


A' 


.39 






B' 


.41 


.17 




C 


.39 


.41 


.42 


(t's Estimated 




10.3 


7.0 


From which 




2 3 

<r A.A'B'C=.706<r A- 
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The various coefficients of correlation and standard deviations required, are 
given in the following table: 



7.0 



a^k. A''\-B'-w = . 711 (T^^. 

These coefficients were calculated by the per cent of unlike signs method 
and only approximate to Pearson coefficients of correlation, which are necessary 
from the theoretical standpoint, but it is thought that they satisfactorily serve 
the purpose of this preliminary investigation. 

The difference between the standard deviations given above is so small 
that the advantage of the regression method over the simple average or sum 
method is plainly too slight to justify the added work, and the measure for the 
algebra test is taken simply as the sum of the grades in the test, after subtract- 
ing the mean and dividing, for convenience, by 5. 

^ . . A' +8' -^C -mean 
That is, At « 



Here, as in the case with all measures used in regression equations, At is a 
deviation from the mean. 



DerivatUm of Formulae 

<y*i4«a*i(l— f^ii) Formula for 2 variables. 

a«i«-o^(l-r^)(l-r«i,.,) 



, I, rSi+»*ii-2riiriirii I 



„ _ I ^_zyu-2Zrurur»'1 Fonnula for 3 variableB. 



r 2t«u-2 



a^ J 

«»\«4-o^(l-rV(l-»*u4)(l-rS4.ii) 



<r^(l-^) (1 ^:-^^ j 

. r Zt^-2 SrurMr»t--ZrSirS4+2 Zmruy^rM I Formi 
L l-2f\i4-2r«rwi4 J ^ ^^ri 



Formula for 
variables. 
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where Zrurnrn—rijriirii+riiriirii+riiriirii Zr'u—r'if+r'ii+r'ii 
2r*iir*i4 »Hiir*i44-r*iir*i44-r*iirSi 
2riiriiri4ri4 " »'u(riarjiri4 +rijri 4rstri4 +f iiTi 4riiri4 



o*i.f+i " rt (1 — »^.t+f) ' 






(nicri<ri-Hnt<ri<rt)« " 1 
<J*i(aS+aS+2rit<ri<rjJ 

(rn<ri-Hni<rt)« " 1 



Similarly, 



. r (ru<ri4-rM<rt4Ti4<r4)* 1 

L <^ +<rS +<r«4 4-2(rit<ri<ri +iiMcrf <r4 4-rM<ri<r4) J 



It may be easily shown that this last formula is general and holds good for any 
number of variables. 

It was attempted to derive a formula for fr^jjust ^^^ paper and patience 
were exhausted before it was accomplished. The law governing the coefficents 
of the terms of the formula for <^ij2ii ^ ^^^ sufficiently clear to enable the 
author to state a general formula applicable to residuals of higher order. 

Grading of Gbomxtbt Test 

The plan adopted in connection with the algebra test is used in combining 
the parts of the geometry test. The following table of coefficients of correla- 
tion (calculated by per cent of unlike signs method) supplies the necessary 
data: 







G 


E' 


F* 


Q' 


E' 




.26 








F' 




-.06 


.13 






Q' 




.22 


.19 


.06 




H' 




.40 


.13 


.09 


.45 


Estimated 


<r'8 




3.3 


7.4 


4.0 



9.0 

E'-problem 1; F'=problems 2, 4, 5, 6; O'-problem 7; £r'»problems 8, 9, 10. 
Problem 3 turned out to be too easy for the group in question, some 98 per cent 
making a perfect score, so its grading is not used. The surprise in this table is 
the smaU negative correlation between G and F*. Because of this small 
correlation F' is also discarded. For the balance of the data the advantage of 
the regression method over the average method is negligible, as the following 
standard deviations show: 

^^Q. E'Q'H* ". 800 (t'q ^Q. E'Q*H' =. 894 (Tq 

^*G. ^'-Hy+E' ^ •^^'7 ^*G ^G. B'+G'+H' " -^^ (TO 

^G. B'-k-r-^-k-H* * . 925 O-Q 

Accordignly the sole measure of the geometry test is taken as the average of 

E\ 0\ H'\ «i.e. Gt 
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Grabikg of the E^^gubh Tebt 

Tbe f oDowing gndingi of the Fngfirfi and hkiory testa may be of paitKakr 
■gnifirance aa eiidenee of ability in FniJirfi: £• (accuracy of deaoiptiao in 
the F^fKaii teat), Er (Tahiatioo of important Cacton in the F^^^ImIi teat), 
W (written ezpreanon in both Kngliwh and hirtory teata), D (dramatiiatioQ in 
both Englidi and history testa). 

Tbe correlatiODa between dramatisation and FniJirfi and history were cal- 
culated by the percentage of onlike sipis method, to determine with wfaidi of 
these subjects dramatization is most closely asMxriated, with the result that 
'ed " '^ (Ister calculation gave Pearson coefficient of correlation to eqoal .182) 
andrgpsi)9. Tbe correlations between English and the other elementa, men- 
tioned above, are as foOows: ^sb »'64, r^* ^.59, ^sw^*^* ^^^^^^ cahtilatfd 

by the unlike signs method. (Later calculations show that these are somewhai 
larger than the Pearson method would give.) Furthermore, the correlation 
between written expres si on and dramatization is .61 (by the unlike signs 
method). The grading for dramatization is seen to be more closely related 
to English than history, but because of its higji ooneiation with written expres- 
sion it contributes little that is unique, even with reference to Englirfi and is, 
accordingly, not evaluated with req)ect to either English or history. 

Another factor in connection with dramatization is the question of whether 
its relation to English or history is linear. In grading the papers, the author 
was quite imfnessed with the feeling that high grades in dramatization were 
more likely to acccxnpany good or poor grades in English than medium grades. 
Tbe author was totally unaware of the English grades of the pupils at the time 
of the grading for dramatization, so there was no reliable foundation for the 
belief. After the grades were available this question was tested by inq>ection 
of the regression line in the correlation table for English and dramatization 
and by calculation of the correlation ratio. The regression line was irregular, 
but did show some evidence of such non-rectilinearity. The value of the 
correlation ratio between English and dramatization is .241. (Compare with 
r£p = .182.) The excess of .241 over .182 is not sufficient to warrant the 

assertion that the regression is not rectilinear, according to the criterion estab- 
lished by Blakeman,^ but the chances are in favor of its being non-rectilinear, 
80 the question is still an open one. 

To return to the determination of the method of combining the parts of the 
English test: the following table of coefficients of correlation (unlike signs 

method) gives the necessary data: 

lii Eft Er tt 

. •^ „r^ Et .59 .86 

^ E. E,+E^+W " <^'e.671 W . 56 . 75 .64 

Estimated a's 2.5 2.2 1.65 

The advantage of the regression equation method is so small as not to justify 
the added labor necessitated by its use, and the simple average, for convenience 
multiplied by 2, of E^, E^ and W, is taken as the measure in the English test. 
That is. Et-i(E.4-Ey-hW-mean). 

* See J. Blakeman, Biometrika Vol. 4, pp. 349-50, for criterion of recti- 
linearity: Here the function of ij and r in question » 1.69, which is less than 
2.5 the required value if non^^ctilinearity is to be definitely established. 
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Grading of Hibtobt Test 

The population in the case of history is small and therefore Pearson coeffi- 
cients of correlation were calculated for the preliminary investigation! instead 
of the less accurate coefficients calculated by the percentage of unlike signs 
method. The data are as follows: 



Hn .31 

<r*H.H. =.904<r«H. ^»^ 2^40 1.69 



^^^ Ht .23 .62 



fini = V.096 ~ .310, and similarly we may say that the total correlation 

between history and the c ombin ed measures H^, H^ is given by the following 
expressions : rfim+^) = V.094 = .307 and r^mn) ^ '^ -102 = .319, where the 

notation ^h(H.H„) ^ understood to mean the correlation between history and 

Ha and H^ when combined into a single measure by the regression equation. 
The above results show that the average, or sum, Hb+Ht, will give a lower 
correlation than Ha alone, and that the regression equation yields but .009 
higher correlation. For these reasons the sole measure of the history test is 
taken to be Ha, for convenience multiplied by two. That is, Ht » 2 (Ha ~ mean) . 

Bearing of the Various Tests Upon MATiraMATics 

(a) Algebra, 

To evaluate the significance of the algebra, English and history tests in 
their bearing upon algebra, the regression equation between these tests and 
algebra grades may be calculated. The following table gives the required data : 

A A test Etest H test 
^VAtEtHt =.728<r»^ At .47 

^A.At+Bt+Ht=-77b<rA g^ 27 .27 .40 

<r*B 4.977 3.856 3.286 5.460 

There is here a material advantage to be gained by the use of the regression 
method, and it has accordingly been calculated: 

Act = 1.316 (A) = .6 (At) +.4 (Et) 4-.11 (Ht) 

(b) Geometry. 

A procedure, similar to the above for algebra, gives the foUowing results: 

^G.GtEtHt =.820<r*Q 

^G. Gt+Bt+Ht"-^^^'G 

Gct-1.53(G) = .8(Gt) + .08(Et)4-.183(Ht) or Get- .8[(Gt) + .l(Et) + .23(Ht)l 

The constant 1.53 has been so chosen that the standard deviation of Get ia 
very nearly equal to the standard deviation of Aet. This is needed, for later Aet 
^ and Get measures are used in the same calculation and called Met measures. 





G 


Gt 


Et 


Ht 


Gt 


.42 








Et 


.24 


.42 






Ht 


.21 


.20 


.40 




<r'8 


5.010 


3.751 


3.042 


6.176 





E 


At 


At 


.35±.05 




Et 


.44 


.37±.05 


Hi 


.40 


.27=fc.06 


it's 




3.917±.2; 



40 
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Bearino of thb Vabious TBam Upon Enqusr 

In the following tables whidi give the data for the calculation of the 
don equations for English with the (1) algebra, English and history tests, 
and (2) geometry, English and histoiy tests, the probable errors of the calcular 
tion involving the algebra and geometry tests are given: 

Since the following coefficients 
of correlation dr their respective E At E«t Ht 

probable errors overlap, 

fg^ and rjBo^; 

%At ^^ %OtJ 

'"HtAt ^^ ^Efi^» 

and since the standard devia- i? o r« rr 

tions of At and Gt ± their prob- ^ Gt Et Hi 

able errors overlap, At and Gt Gt .3ld:.07 

may be combined into a single Et .44 .42=k.07 

mathematics group, Mt, without Ht . 40 . 20 d= . 08 .40 

materially affecting the regres- (t's 3.860d:.29S 3.274 5.440 
sion equation. 

The regression equation has, accordingly, been calculated from the follow- 
ing table, in which the coefficients of correlation involving the algebra test 
and geometry test are weighted averages of the coefficients for the algebra and 
geometry tests separately: 

From this table are obtained £ m^ £^ H^ 

the following standard devia- «| 04 

*^^°^'. ^^ . Et* '.U .38 

<^^MAHt = 722<r»B Ht .40 .25 .40 

<^VM,+E,+H,-.729cr^ <^'B 5.254 3.896 3.274 5.440 

There is so little difference between these standard deviations that ths 
simpler method is used, i.e. E » > designated by Ect. 



Beabing of thjd Vabious Tests Upon History 

By parity of reasoning, the same English combination measure, Eet, is used 
to correlate with history. The data bearing upon the problem are as follows: 

From which it may be deduced^ that r^^ « .455. (This value is used in the 

calculation Appx. p. 105, but care should be exercised in using values obtained 
in this way as it should be noticed that errors are cumulative and an error 
introduced here by throwing away .OOl's, or for other reasons, may affect a 
subsequent correlation considerably.) 

* Same method used as in paragraph upon Grading of Histoiy Test, Appx. 
p. w. 





H 


Mt 


Et 


Ht 


Mt 


.37 








Et 


.35 


.38 






Ht 


.31 


.25 


.40 




<r'8 


5.156 


3.890 


3.136 


4.796 
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Interest Tests — Grading of Boot!^' 






In expresBing the grades of the books 1, 2, 7 for Ewjefiflh, as deviations 

from the mean, a nonnal distribution was assumed for the gra^^given by each 
of the judges — ^this method seemed to be necessary as the means for ^e di£Ferent 
judges varied appreciably — and use was made of the same kind of « jmnsf orma- 
tion as in expressing literal grades in numerical terms. 

In the case of the history grading, it does not seem reasonable to^ assume a 
normal distribution, as a straight history is surely a greater distance above, the 
mean, as evidence of interest in history, than is a book like "Kite Flyidg for 
Bo3rs" below the mean. No simple method is at hand to tell the nature of tbc^ 
distribution of the books with reference to their historical significance, but the 
assumption of a skewed distribution of some sort is surely more reasonable 
than the assumption of a normal distribution. A distribution skewed .75 was 

assumed, skewness being measured by the formula • * With 

a distribution so skewed, grades 1, 2 7 were expressed as deviations from 

the mean in the same manner as was done for the grading of books for English, 
and for literal grades, under the assumption of a nonnal distribution. 

It may be mentioned that the calculation of the reliability coefficient for the 
grading of books foi history was done before the above-mentioned transforma- 
tion was made, so that a small inaccuracy is present. Calculation of this 
coefficient after the transformation would raise its value a little above the 
obtained value, .720. 

In grading sports, entertainments, words and magazines, it is not necessary 
to resort to a transformation, for even though the means should be quite di£Fer- 
ent for different judges, a simple average may be taken; for the standard devia- 
tions of the grading of the different judges were found to be very nearly equal, 
and every judge graded every item except in the case of magasines, where the 
means, as well as the standard deviations, were nearly equal. This does not 
introduce the error that would have resulted from such a procedure in the case 
of books, where the books that were graded by only two judges were not, in 
many cases, graded by the same two. 

Grading of the Interest Tests with Reference to (a) English, (b) 

Mathematics and (c) History 

The data in the following table serve as a basis for combining the various 
parts of the interest test into a single measure to correlate with English. 

Bks. 
Sports 

£4itertainments 
Vocations 
Factor of accuracy 
Words 
Magazines 
Books 
<r's 



E 


Spts. 


Ents. 


Vocs. 


F.ofA. 


Wds. 


Mags. 


.20 














.14 


.5 












.24 


.3 


.1 










.04 


.2 


.1 


.1 








.26 


.3 


.0 


.1 


.7 






.37 


.4 


.3 


.4 


.2 


.2 




.13 


.3 


.0 


.2 


.0 


.3 


.3 




1.965 


3.512 


2.059 


4.286 


4.161 


2.232 



2.428 



^ The actual distribution used is that represented in Thomdike, Mental 
and Social Measurements. Ed. 2, p. 74. but any reasonable distribution with a 
skewness of .75 would jdeld comparable results. 
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• m 



The coefficients of <oqprrehtioii in this table which inyohre Fngjinh were cako- 
Uted by the PearMSrf fonnuU, and the balance by the percentage of unlike 
signs method.^ *- '- ' 

The BtBndtii:4i^vuLtiofDB given in this table are not the standard deviations 
of the oriffii&l measures. Certain of the measures were grouped for ooo- 
venienoermhiaidling: The following relations h<^ between the above stand- 
ard dev^tl^ and the standard deviations of the original measures: 

. 1 . 965*^ Standard deviation of original grading of sports. 
^••512= " " " " entertainments. 



« « 

t€ tt 



•. 2.(159 = 
/ V.*.286=20 
••...'4.161= .2 " 
:•. 2.232=3.3 " 
• 2.428=3.3 



It it 






vocations, 
factor of accuracy. 
" words. 



It 



magazines, 
books. 



• » 



The labor involved makes it plainly out of the question to calculate a regular 
regression equation, so that a rough approximation only has been attempted. 
Since the grading of the magazines correlates the most highly with English, 
the effect of that one factor is taken into account by calculating partial coeffi- 
cients of correlation of the tjpe r^ g^ . n^^ r^ g^^ . ||^^, etc. All such par- 
tial coefficients of correlation are given in the accompanying table except 
''e F of A • lUd' '^^ factor of accuracy is very highly correlated with the 
grading of the words, and is therefore evaluated in connection with it. 

'•EFofAWdi=- 206 r^^^ . Mi«s= 061 

'"EWd.FofA" 325 rgan,.H^=.033 

Probably the average of r^ ^^ . n^^^ ^e Vocb • lUgi ~ • ^^ 

and fB Wdt • F of A gives a better weight ^E Wdt • lUgi ~ - ^04 

than either alone. ^E Bki • lUgi ~ - ^^ 

This gives .265 as the weighting for Wds. and proportionately —.168 for 
Fof A. 

The weight assigned to magazines is the average of the following partial 
coefficients of correlation: 

*'EIUn-8|rtf="-^l 

^ElUnEiiti'"-^^ 
*'EIUhVocb=-308 

^E Man • BkM ~ -3^ 

average =.338 

Having weighted Mags .338, proportionate weightings for other variables are 
as follows: 

'^'"m' ^-^«KbtingforSpt8. = .062 

Similarly " " Ents. = . 032 

"Voc8. = .119 
"Bks. -.020 
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Since Spts. and Ents. are highly correlated, the weights assigned to them above 
are somewhat too high. A small amount is arbitrarily deducted from the 
above weights. The final weights assigned are as follows: 





Wts 


Spts 
Ents 


.058 


.026 


Vocs 


.119 


Fof A 


-.168 


Wds 


.265 


Mags 


.338 


Bkn 


.020 



These weights, divided by the respective standard deviations, give the multi- 
pUers of the various measures used to obtain a single interest and information 
test grade. The single grade for the interest and information test in its bear- 
ing on English (£^) is accordingly given by the following equation: (In the 
following equation the letter E indicates that the grade assigned is in relation 
to English.) 

. 1515 Ei » . 0295 (Espti) + . 0074(EEnte) + . 0578 (Evoes) - . 0392(F of A) 
-h . 0637 (Ewck) -h . 1515 (Eiii«*) + . 0082 (EBfa) 

( . 1515 is taken for convenience, to make the coefficient of EiUgi equal to 
unity.) 

/. Ei = . 195 (Espti) -h . 048(EEnta) + . 382(Evocb) . 259 - (F of A) + . 420(Ewd.) 
+ 1 . 00 (EMaci) + . 054 (EBki), or, for practical purposes, 

Ei=.2(Eflpta)-h.0i(EBnte)-h.4)(EvocB)-.2i(Fof A)4-.4(Ewd.)-hl.0(Eiiin,) 
+ .Oi(EBki) 

The same relative weighting is assumed in obtaining a single measure of the 
interest and information test to correlate with history (H) and with mathe- 
matics (M), except that the F of A is weighted di£Ferently, since ^h P of A *" *^^ 
and ^M F of A " *^^^' "^^ following weighting is used. 

Hi - . 2 (Hspta) 4- . Oi (HEnte) + . 4 (Hvocb) - . 1 (F of A) 4- . 4 (Hwd.) 
+1.0(Hiiiu,) + .0J(HBk8) 

Mi=2[.2(M8|rti)4-.0i(MEnt.) + .4(Mvofl8)4-.0i(FofA) + .4(Mwd.)l 

The factor 2 in this last equation is simply for the purpose of obtaining a 
more convenient distribution — by maintaining distributions with 20 or mora 
divisions it is not necessary to correct for grouping or for arbitrary means. 

Combination of Parts of Interest Test Mi, Ei, Hi, with Refbebnci 

TO (a) MATEraMATICS, (b) ENGLISH, (c) HiBTORT 

(a) Mathematics, 

Although the interest test has been graded specifically with reference to 
mathematics, it may be that the gradings with reference to English and history 
give some light upon the most probable mathematical standing of the pupiL 





M 


Mi 


Ei 


Mi 


.24 






Ei 


.20 


.21 




Hi 


.15 


.54 


.63 


Cb 


4.93 


4.64 


3.13 
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The calculatioD of the regranon eguatioii involvin g M, M{^ Ei, and Hi wiO 
decide the queetioiL The data for thii ealenlatioa folW: 

From this <F<||jl^l^B. 91 1<F<M, M Mi Ei Hi 

from which it may be deduced that 

This correUtioniflcoDsiderablv above . m nn a a^ o ^o a m 

the correUtion for r,IM.,whici equate ^^ *-^ *®* 3. 13 6.12 

.24, and by inspection of the table, it te apparent that it te considerably above 
^UOL-^Et-j-E^t ^^ ^^ ^'^^ stazbdard deviation for history (6.12), operates, when 

taking an average or sum, to wei^t the history grading the highest, so the 
regression equation method te pteonly the method needed. Calculation gives 
the following: 

4.701 4.701 „ 4.701 _ 

^-•223S3-:^Mi+.1826^;^Ei-.095^5^Hi 

«.2822 Mi+.3669 £i-.1120Hi 

Multiplying by the convenient factor, .5646, and deaignating the result by Md 

(combination of the parts of the interest test with reference to mathematics) 

gives the following: 

MfliB.500Mi+.650Ei-.199Hi, or for practical purposes, M«-i.5Mi 
+ .65Ei-.2Hi. 

(b) English. 

Similar data with reference to English are: 

From this E Mi Ei Hi 

^.MjEiHi- 783<r*B Mi 

from which it may be deduced that g-*. 

*'B(MiEiHi)-.464, <r»8 6.5» 4.64 3 13 6.12 

but as r£2."". 46 there is practically no object in using the longer method. 

E| te therefore taken as t&e sole measure of the interest test in its bearing upon 
English, and for such use will be designated E^. 

(c) History, 

The data referring to history are as follows: 

From this . _ H^ Mi Ei Hi 

from which it may be deduced that 

^H(M|BiHi)->.353 a's 5.10 4.64 3.13 6.12 

It is evident that ^h(M'+E:+ho ^ appreciably lower than this, for the rather 

laige standard deviation for Mi (4.64) would operate to weight Mi quite 
heavily. The correlation .353 is sufficiently higher than the correlation r g» 

(.30), to nuike the regression equation desirable. By calculation, 

4.891 4.891 „ 4.891 „ 

--. 2070 Mi+ . 1585 Ei+ . 2910 Hi 



E 


Mi 


Ei 


.15 






.46 


.21 




.32 


.54 


63 


5.23 


4.64 


3.13 





H 


Mi 


Ei 


Mi 


.02 






Ei 


.27 


.21 




Hi 


.30 


.54 


63 


it's 


5.10 


4.64 


3.13 
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To obtain a convenient distribution and a simpler equation to woric with, 
this equation has been multiplied by 2.406. The result is designated by H«|. 

H«i - -.408 Mi+.381 Ei+.700Hi, or for all practical purposes, Ha- —.6 Mi 
-f.38Ei+.7Hi. 

Combination of the Mateoucaticb Tests, Met and Mei, with Rbfbrbncb 
TO Mathematics. Similar Combinations or ESnqlish and Histobt 

Tests 
(a) MathemcUica, 

On page 99 of the Appendix, mathematics, English and histoiy tests, Mt, E|, 
Hi, were combined into a single grading. Met, which gives the total bearing of 
these tests upon mathematics. On page 104 of the Appendix, the gradings of 
the mathematics, English and history interest tests, Mi, Ei, Hi, are combined 
into a single grade, Moi, which gives the total bearing of the three interest 
tests upon mathematics. It now remains to combine Met and Ma into the 
single measure which correlates the highest with M. This single measure will 
be designated by Me, and is given by the following regresBion equation, which is 
based upon the accompanying data: 

M -. 1606 f^l^ Mei 4-4198^^ Met Md .30 

Mm! 48 85 

Multiplying by the convenient factor ^^ .'oo i'oq q ^g 

1.556 gives: 

Me B . 658 Mei + 1 . 00 Met, or, for practical purposes, 

Me».66Mei+Met. 

This relative weighting is used whether it is desired to combine the grades 
of the tests with reference to algebra or geometry. If the derivation of regres- 
sion equations for algebra and geometry had been undertaken separately, the 
difference from the above weighting would have been slight and the increased 
correlation due to the more exact weighting would have been inapineciable. 
The terms Ae and Ge will be used instead of Me, when it is desired to speak 
of the algebra combination, and the geometry combination, rather than the 
mathematics combination. 

(h) EnglUh, 

Data for English, similar to the above for mathematics, are given in the 

accompanying table: 

E Eei Eet 
Eei .46 

Eet .46 .34 

<r'B 5.23 3.21 3.23 

^^^ fm. "''sEflt' ^^ ^Ku ^ ^^^7 nearly equal to (t. , a straight average or 
sum of the two measures is the desired combination, i.e., Ee^Eei+Eet. 

(c) History, 

The data for history are given in the accompanying table: 

Calculation gives: H Hd Het 

XT— 01KA ^ ■ "O XT . i QTOO *_L*Z^ XJ X I^ '33 

^ -^^^ 4120 ^"^-^^^2^13 ^•* Het .45 .33 

= . 2168 Hd+. 5979 Het <^'« 6.10 4.80 8.23 
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MoHiplymg by the eonvenient factor, 1.673, and desigiiatmg the reaiilt by 
H«->.1814 Hci+1^ H«i, or, Bpfpnanmaiely, He «.2Hci+Het. 

COMBIKATIOlf OF EUBMENTAST ScHOOL SfTASDlSQ, TeaCBXBS' EsTIMATBB 

AMD Test Stamdiko with Reweresce to Average Class Standing 

The estimation of average class F^ 7,6,5,4^ Est^ T^ 

standing based upon au three 7,6 5 4a .83 

sources of data is by means of the 'vLA 81 68 
following regression equation, based '^ 

upon the accompanying data: TA .51 .56 .54 

.4456^''? .4458<^F 

Fa« .6422 \ (7, 6, 6, 4a) + .51»3— —- ^ErtA 

.5340<r(7. «. «, 4^ .o666<r2^ 

-.0771— —-if Ta. 
.7»73<n' 

A 

The equation is left in this form for reference to it. The vahiet of the variooi 
standard deviations are: 

(Tj "3.662; <r^^^,^v -4.665; Oj^ -6.660; <r.p -3.845. 



i 



SECTION 12 
GRADE AND TEST DATA 
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HIGH AND ELEMENTARY SCHOOL GRADES 

BXPRB888D AS DBTIATIONB FROM MEAN 



J . 


HiskSduMl 


74hOr. 






OlhGi 


r. 




StiiOi 


• 




4th G 


f. 


1^ 


!•( 


\jmx 




























1 


Fm 


Vm 


F4T 


7h 


7b 


7a 


6» 


6a 


«a 


6m 


6b 


6b 


4m 


4b 


4a 


4 


3 


-1 








3 


-1 


1 


1 





1 


2 


1 





-1 





-10 


-10 


-6 


1 


2 





1 


3 


1 


1 


3 


1 





1 




10 


1 


-1 


1 


-2 


-3 





-1 








1 


-1 


1 





4 


-0 


12 


3 


-4 


3 








-1 


-4 





-1 


-3 


-3 


-2 


1 


2 




14 


-4 


-6 


-6 


-2 


3 


2 





7 


1 





6 


4 


-2 


8 


^8 


16 


10 


8 


9 


-3 


-4 


-4 


-2 


-6 


-3 





-3 





-2 


-4 


—2 


16 


-1 


4 


3 


1 


-3 


-2 


2 


-3 





1 


-2 








-3 


— 1 


17 


1 


-2 


-2 





1 


1 


2 


3 


2 


1 


3 


1 


1 


3 


8 


18 


-3 


-1 


-2 


1 


2 


1 


3 


6 


2 














2 


-2 


24 


10 


8 


7 





-1 


-3 


-4 


-6 


-2 





-6 


-2 


-4 


-6 


-8 


26 


7 


4 


6 





3 


-3 


-1 


3 


2 


-3 


3 


-2 


-4 


-3 


~8 


29 


7 


4 


6 


-3 


-2 


-2 


-3 


-4 


-2 


-1 


2 





-3 


-4 


— 1 


36 


8 


4 





-3 


-3 


-2 


-2 


3 


1 





3 


2 


-4 


2 


2 
~0 


38 


3 


8 


4 


-2 


-6 


-1 


-3 


-6 





2 


-3 


1 


-2 


-4 


39 


6 





-1 





1 


-2 





3 


-2 


1 


2 


1 


1 


2 


40 


-6 


4 











1 


1 


-1 





-4 


-6 


-1 


-4 


-6 


.1 


41 





-1 


-3 


2 





-1 


1 


-2 








3 


2 


2 







42 


-1 


-10 


-6 


2 


4 





-1 


3 


1 


-3 


2 


1 


-1 


3 




46 


7 


1 


1 


2 


-1 


-1 


-3 





-2 


-3 


-3 


-2 


-4 


-6 


->8 


46 


-4 


-2 


-3 


1 


-1 


1 


-2 


-1 





1 





1 


-2 


1 


—8 


47 


5 


1 


2 





2 





-1 


-1 








3 





-1 


2 




63 


5 


4 


6 


-3 


-3 


-3 


-3 


-3 


-2 


-1 





-2 


-2 


-3 


—3 


66 




-2 





2 





1 


2 


2 


-1 


-1 





1 


3 


2 




76 




-6 


-6 


1 


1 





1 


1 


, 1 


-8 


-2 


-1 


-1 


3 




89 




-2 


-3 


1 


2 





2 


-3 


1 


3 


-3 


1 


1 







08 




-1 


-2 


2 


3 


2 


4 


2 


2 


1 


3 


3 


6 


6 




103 


-4 


3 


-1 


2 


-1 





1 


-2 


-3 





-2 


-2 


2 


-3 


^1 


106 


-3 


-6 


-3 














1 








-2 


1 


2 


-2 




109 


2 











3 


-1 


-1 


-1 





1 


-2 


1 


-1 


-3 




110 


12 


9 


10 


-1 


-2 


-3 


-3 


-3 


-2 


1 


-6 


-3 


-1 


-6 


—8 


112 


-3 


-2 


-2 


1 


-2 





1 


2 





1 





1 


-3 


-6 


— 1 


113 


4 


-2 


1 





6 








6 








6 


2 


2 


2 




116 


4 


-2 


2 





-2 


-1 


1 


-1 





-3 





-2 


-1 


-4 


— 1 


123 


3 


^.4 


-1 





6 


1 





4 


1 





3 


2 


-3 


-3 




126 


-6 


-4 


-4 


1 


3 








2 


-1 


-8 


1 


-2 


3 


2 




127 





-4 


-2 


-1 


2 








3 


-2 


-3 





-1 


-2 







128 


6 


-2 








2 


-1 


-1 





-1 


-1 








-2 







129 


8 


9 


9 


-1 


-3 


-4 





-6 


-2 


-3 


-6 


-8 


-1 


-4 


— 1 


130 


-2 


-2 


-3 





2 





1 


2 





2 


1 


2 


-1 





—2 


186 


-1 


6 


2 


-1 


3 


-1 


1 


2 








-2 


1 


-1 


-1 


^1 


188 


8 


6 


6 


-2 


-1 


-1 


-4 





-4 


-2 


-4 


-2 


-3 


-1 


^1 


143 


6 


7 


7 


-1 


-2 


-2 


-1 


-3 


-3 


-3 


-6 


-3 


-3 


-6 


—3 


146 


2 


6 


3 


-1 


-1 














1 


-6 





-3 


-6 


— 1 


147 


6 





3 





3 


-1 





-4 


-1 


-3 


-1 


2 


-2 


-4 


—3 


148 


2 


6 


3 


-2 


-2 


-1 





-1 





-2 


-6 


-2 


-1 


-3 


— 1 


161 


6 


-2 


2 





-2 











-1 


-1 


6 


-1 





2 


^1 


162 





1 


1 


1 


2 














-1 


-4 


-1 


-1 





^1 


183 


-1 


2 


1 


-1 


2 








1 


-1 


-3 


2 


-3 


-3 


-1 




164 





6 


3 


2 


-2 





3 





1 


1 


-6 


-1 


1 


-1 




166 


-2 


2 


-1 


-1 


1 





1 


1 





-1 


-6 


-1 





-6 


— 1 


167 


4 


-2 





4 


-2 


1 


1 


2 


-2 





2 


-3 


1 


-2 




160 





1 





1 


-1 





-1 


-3 


-1 


-3 


-4 


1 


-1 


1 




162 


-1 





-2 














2 


2 





-2 


3 


2 


-1 




166 


6 





3 


1 


1 








2 








-1 


1 


1 


-2 




168 


6 


8 


4 








1 





-3 


-1 


-1 


-2 


1 


-3 


-8 




169 


-8 


3 


-1 


1 





2 


1 


-8 





2 


-6 


-2 


2 


-6 




172 


-2 


-8 


-6 





3 


1 





2 


1 


-2 


-2 


2 





-1 




173 


2 


2 


1 





1 


-1 


-1 


1 


-1 


1 








1 


-3 





174 


-6 


7 


6 





-4 


-4 





-4 


-4 





-6 


-3 


1 


-4 


1 



108 



Educatianal Outdance 



I 



ioo^eiooo<-«oco^«^ekiOeo«>o«>o^io«> 



I 



^11 I I III I I 

•O- -W , , , ^ , , ,111 ,11 



} 



H II II 

*a II I III 

»0-''W I I I I I I I I I I I 



O 



QQ 



2 



I 



I 

i 



'■1103 



II III I 1^1 I 

^e9oe««o^io«c«aooM^ao«^coe9^Maoo 
I -^ I I I I I l^'^ I I I 

1*^ I I I I l'^'^ I 11 



io«oooo^Me«o«iooM<4ie4«eieioo^ 
I I I I 1*^ I -j* I 



•|«W!W o 



'iaO ^ 



«Q< 



1 

Q 


+ 
AQO» 


+ 
A Q 


H 


+ + + 
OQ QOAAOAOQU 



•jj A O H 

+ + + + ++ 

'idivi <Q O OOHOQAOH<<AHQQ 

+ 1+ 1+ I 

1W0«O <<OAO QQQOOAOQ-<AAO 

+++ + + 

+ ++ ++++ ++ 

•9aa AAOAQAOOOAQOAO-^AAQAO 



+ + + 

'FI •<OOAQAAAQOA*<QO<<<<OAA»Q 



'lA pas— 'H 
*iXinfW|»8— 'H 



+ 
AQQ 



+ 



QA 



1 + 
HO 



+ ++ 
•a AA0AQOQOOAqAAO'<'<0AOAO 

/ + + + I + + 
•«w»0— 'W •<AQAQOOAQQQAOQ'<'<QQ«0Q 



I 



VI M eo <4i lo o i<*oo 9 o «^ M CO ^ lo « t^ oo Ok e :j 



Appendix 100 






17 I I I I I I I i I I I M I I "j* ^ 



M^«o«i40«o«Ov4ei»40*4^«^Meie9^«oo«^ei^«^o«^oeie9M ^i<* ^«^«om 
III I I I I I M I III I I I I I I 

III III l-*l I M I III MM M-^-^Jl 



I I I I'j' I 7 I I M I ^ \ i-y 

eieiM«^«e9ioioe*>e^ mmoi^io^mo mmmv^co coot «^ «^io 

I I I II I 1^ I I I 



«^eo«Moo»4»4«ieco^«o^ei«oo«e«iooioe«io^eeoMioe4Mao»40e9iOMoio 
I I M I I I I II I I II 11 I 



«ie«<e^eiOMooo<ei<*Mc«ei«^Meoei^<4i^MaoMaooo«o^MiooMM 
7 I I II I II II 1-^ l'^ I 

M 11 I I II TT I II ^ "^ I 

M^o«eeieiei«oeicoMeiei«oi<*«o^i<*e«ioioeoc«o»4MMc«e«oM^^Moio 
I II II II II II M II I I 

17 I I I II I I li-^ II 1*^ I T 
+ '. + + + + I +^ 

n A AA A mm oq»q m<CimQm o qqu 
,^ + ++ + + ++ + 

+ +++ + ++ 4. +++ + I 

Q •<u Qu Qonoonono on qqa o onoQQ on 

• + +I+++ + + I 

OQOO OQAQQ QO QA OO O ^ ^^ Q^ A 

+ + +I ++ ++ +1 

oQnu OQAOQ on q<< oq qq q on qo 

+ + I + + 

«»< o o •< Q o o n oonQH 

, + + + + +++ + + + ++ +++ + + + 

oonn'<nonnQOQOonn'<onQQQOoonooQOOonnooQO 

oQ<<n'<n n HQQO'«n'<nQ»QQonO'<Qnon no n'<oQ 

+ + + 

« o Q n n 00 

+ i +' 

< Q « OOOfiW 

-H-+++ ++ ++ ++ I I++ + + + 

oQnn<<nQnnHOQnnnn<QnnQoonQnooQnono<noQQ 

++ I +++++ + + 

OQ<n'<QHnQQQQO'<no<<nHQQQOOQ'<QOQn no onq 



S9S^SSS^SS8S3SSSSSSSS?:;99^SS!?99S:SSSSSS^S8 



Educational Guidance 



-■iw 



I - I I I I II 






■'«*'« «OQ eaa 



q I 



'**! QUaUQQ UQHHnU H 



"([T— 'H auu^unuaanuQaanuo 






1 1^ 



::33«8se3«eE!!i!:i 



Appendix 111 






i I I -^ I I 1*^ I l-y I I I 

I I I I i i ill I 

I I I I I I I I I I I 



II I 11-^ T-j* 
II II I I I I I 

II II I I I I I 



'^ I II I II I I I I 

I I I 1^ I I I I I I Y ' ' I I 

^io^e«cDei^ ^ «ooe« CD 04 0^0^040^ e4«^e4o«e« 
I 111-^ I \ 'J \ \ ^ \ \ 

<DiOc«c«'He«eo<4iiooioee4e4^^t^^e40t^e4cacaoe« 
I I 11-^ II II I l-j* 



+ 1+ ++I ++ ++ + 

+ 

Q Q O O 

I + 

HO H O Q 

+ + ++ I + 
nOH HO QAAO QOOOOOOHQQq 

+ + +++ ++ +11 + 
O0nQQOQnQ<QOooAnnOC>OQQQAOQ 

++++++ + + + 
+ ++ +++ + ++ 

+ + + + ++ + + 

+ 

+ + ++ + ++ + + 

QonnQQQA AQnoO'<nAQnQnHonoo 
+ + ++ + + + 



•^t^RwOOOdQOQbao8aOww90kOOkdk0090lSoO 



EdxtoaHonid Guidance 





J 

i 
1 


IH "- 


-7-T27S< 


°7"777T 


2*72 — " 


77°"- 






1 1* 7 


,-,>..-. 


""77 "7" 


t III 


^ 


•a " 




7"°"7"7' 




"77" 




Tf77-7"" 


' ' 


77777"°- 






~7 


7"°-°"7' 


*7777"7" 
777=772" 


""77° 

« OK- 


i 




T~» 7" 


=-7»272" 


!!*!!II 


2777=7"' 


"""'7 

<eooo« 






-< ^QO Qi 
O Q 



"PB otlQ(0OO-<U« ( 



QOauuu aUQUMuna 



i 1^ 



, +++ I + + ++ + + + + 



Appendix 



5^,.,o.-,,.as.,-.,-.-2— .a-s-Y-— 7-7s«;« "7— 7==-- 
777'-"7t— -■°"°"-77r-7°°T°77°°77-777 ■•7-"777°- 
"T7— ■7-"77"=-7771'T7-«-"7-7777— 7»T 77»7"77— 

= 777-777"=— "■■7rT77 1' 77-"=°"77°"f "' 

" •77-7-77"-77-7=~-— " —77' ■777-777"'7"°T7 "" 
77777"'T"***° 7-'-'T7=-"77-T77-7""7— 777-2— = 


° "77— 77-5— <-=-=7=77=*777=7=7"7T-7'-7"7°7777-"7« 



I I I I r7 1 I I 

YT"""'T7T 



HcBu a 00 a von a o a noo a < 



Q Ua « UQ u 



Q U UO U 



pQ-^on a o 



a n u o Q a UU Q mn um oa u o a ■<UQUa Qooaooooau^o ^ UQ QOn uu nun on Q ■< 



B33S§S§S3332:SsHSsSSS3S532§sSSS§H§§§SBBSS^B§S£sS 



114 Educational Guidance 

I iD-i« -7™T-f7-— r™ 7777— 7-f7- 
I I 

"I t *= 

a * ■■■I 



i 1^ 



■fftl OOMODO ■<OM0a(0OPSM0aOOOO«»O» 

li+ 1 ++ ++ 
■"o ooaoo o ooOao no oo«o 

+ + 

''3 ■< ■< an ■<« ■<O-<(0(q^0S ■< ■< 

+ ± + i 

'»a auoMnonnnnnnnunonnuuonnufl? 
+ J. + +++ i+l++ J. 

+ + + 

-3 nQu-<nun ■<fln-<no«aounnunanano 

+ + + + + 



Appendix 



1 I 



ll 



<B -" 


""'•T"*" 


.,— . 


,,-.-^=-.. 


1-t 


7Ti 


'TT-= 


_-o.--oo.- 




•t-iTt- 


"T7-" 


11 1 Mil 


*H "" 


'=T?7 V 


"?■=- 




■a — 


—o.- , 


.»--, 


one -r «MMe 


»▼-•*« "T 


"TT7" 


-=»-. 


""T°—°T7" 



a V aununnn-^ 



ousuuAunEauuueoaBunnouou^n^ 



. oomuia-^-<«om!OMoaio«n««i 



1 + + + +++ 1 + 
) G o OUDM uounn no auu uuu 



^ + 1 - +1+ -+ + + + 
+ +1+++ + + ++'+ ++ + 



'a <;}U0[i)auo<uununuunnuQnc;aiii«4 

*=.»,- + ■'■ - + +-+ + 

^iv — n ooojooouMOtfuiBBoooouijtoomBo-"! 



i 1- 



ssagssssissisg 



116 Educaiumal Guidance 

HIGH AND ELEMENTARY SCHOOL GRADES 

BXPRKSBD AB MTIATIONS FBOM MEAN 



1 


HigkSdMol 


7th Or. 






Ml Off. 




6«kGi 


• 




4tiiQff. 


h 


lit7«tf 




























3 


Fm 


Fi 


Fat 


7u 


7b 


7a 


6i» 


6b 


ta 


6m 


6b 


&B 


4m 


4b 


4a 


4 


3 


-1 








3 


-1 


1 


1 





1 


2 


1 





-1 





-10 


-10 


-5 


1 


2 





1 


3 


1 


1 


3 


1 





1 




10 


1 


-1 


1 


-2 


-3 





-1 








1 


-1 


1 





4 


-0 


12 


3 


-4 


8 








-1 


-4 





-1 


-3 


-3 


-2 


1 


2 




14 


-4 


-6 


-5 


-2 


3 


2 





7 


1 





6 


4 


-2 


8 


—3 


15 


10 


8 


9 


-3 


-4 


-4 


-2 


-6 


-3 





-3 





-2 


-4 


—2 


16 


-1 


4 


8 


1 


-3 


-2 


2 


-3 





1 


-2 








-3 


—>\ 


17 


1 


-2 


-2 





1 


1 


2 


3 


2 


1 


3 


1 


1 


3 


3 


18 


-3 


-1 


-2 


1 


2 


1 


3 


5 


2 














2 


-2 


24 


10 


8 


7 





-1 


-3 


-4 


-6 


-2 





-5 


-2 


-4 


-6 


-8 


25 


7 


4 


5 





3 


-3 


-1 


3 


2 


-3 


3 


-2 


-4 


-3 


•"8 


29 


7 


4 


5 


-3 


-2 


-2 


-3 


-4 


-2 


-1 


2 





-3 


-4 


— 1 


3d 


3 


4 





-3 


-3 


-2 


-2 


8 


1 





3 


2 


-4 


2 


2 

■*o 


38 


3 


8 


4 


-2 


-5 


-1 


-3 


-5 





2 


-3 


1 


-2 


-4 


89 


5 





-1 





1 


-2 





3 


-2 


1 


2 


1 


1 


2 


40 


-6 


4 











1 


1 


-1 





-4 


-5 


-1 


-4 


-5 


— 1 


41 





-1 


-3 


2 





-1 


1 


-2 








3 


2 


2 







42 


-1 


-10 


-6 


2 


4 





-1 


3 


1 


-3 


2 


1 


-1 


3 




45 


7 


1 


1 


2 


-1 


-1 


-3 





-2 


-3 


-3 


-2 


-4 


-6 


—3 


46 


-4 


-2 


-3 


1 


-1 


1 


-2 


-1 





1 





1 


-2 


1 


—3 


47 


5 


1 


2 





2 





-1 


-1 








3 





-1 


2 




53 


5 


4 


6 


-3 


-3 


-3 


-3 


-3 


-2 


-1 





-2 


-2 


-3 


—8 


65 




-2 





2 





1 


2 


2 


-1 


-1 





1 


3 


2 




76 




-6 


-5 


1 


1 





1 


1 


. 1 


-3 


-2 


-1 


-1 


3 




89 




-2 


-3 


1 


2 





2 


-3 


1 


3 


-3 


1 


1 







98 




-1 


-2 


2 


3 


2 


4 


2 


2 


1 


3 


3 


5 


5 




103 


-4 


3 


-1 


2 


-1 





1 


-2 


-3 





-2 


-2 


2 


-3 


— 1 


106 


-3 


-6 


-3 














1 








-2 


1 


2 


-2 




109 


2 











3 


-1 


-1 


-1 





1 


-2 


1 


-1 


-3 




110 


12 


9 


10 


-1 


-2 


-3 


-3 


-3 


-2 


1 


-6 


-3 


-1 


-5 


—8 


112 


-3 


-2 


-2 


1 


-2 





1 


2 





1 





1 


-3 


-6 


— 1 


113 


4 


-2 


1 





6 








5 








6 


2 


2 


2 




116 


4 


-2 


2 





-2 


-1 


1 


-1 





-3 





-2 


-1 


-4 


— 1 


123 


3 


-4 


-1 





6 


1 





4 


1 





3 


2 


-3 


-3 




125 


-5 


~4 


-4 


1 


a 








2 


-1 


-8 


1 


-2 


3 


2 




127 





-4 


-2 


-1 


2 








3 


-2 


-3 





-1 


-2 







128 


5 


-2 








2 


-1 


-1 





-1 


-1 








-2 







129 


8 


9 


9 


-1 


-3 


-4 





-5 


-2 


-3 


-6 


-3 


-1 


-4 


— 1 


130 


-2 


-2 


-3 





2 





1 


2 





2 


1 


2 


-1 





—2 


135 


-1 


5 


2 


-1 


3 


-1 


1 


2 








-2 


1 


-1 


-1 


— 1 


138 


8 


6 


6 


-2 


-1 


-1 


-4 





-4 


-2 


-4 


-2 


-3 


-1 


— 1 


143 


6 


7 


7 


-1 


-2 


-2 


-1 


-3 


-3 


-3 


-5 


-3 


-3 


-5 


—3 


145 


2 


5 


3 


-1 


-1 














1 


-5 





-3 


-5 


— X 


147 


6 





3 





8 


-I 





-4 


-1 


-3 


-1 


2 


-2 


-4 


—3 


148 


2 


5 


3 


-2 


-2 


-1 





-1 





-2 


-5 


-2 


-1 


-3 


>.! 


151 


5 


-2 


2 





-2 











-1 


-1 


6 


-1 





2 


— 1 


152 





1 


1 


1 


2 














-1 


-4 


-1 


-1 





m^\ 


163 


-1 


2 


1 


-1 


2 








1 


-1 


-3 


2 


-3 


-3 


-1 




154 





5 


3 


2 


-2 





3 





1 


1 


-6 


-1 


1 


-1 




156 


-2 


2 


-1 


-1 


1 





1 


1 





-1 


-6 


-1 





-6 


— 1 


157 


4 


-2 





4 


-2 


1 


1 


2 


-2 





2 


-3 


1 


-2 




160 





1 





1 


-1 





-1 


-3 


-1 


-3 


-4 


1 


-1 


1 




162 


-1 





-2 














2 


2 





-2 


3 


2 


-1 




166 


6 





3 


1 


1 








2 








-1 


1 


1 


-2 




168 


6 


3 


4 








1 





-3 


-1 


-1 


-2 


1 


-3 


-3 




169 


-8 


3 


-1 


1 





2 


1 


-3 





2 


-6 


-2 


2 


-6 




172 


-2 


-8 


-5 





3 


1 





2 


1 


-2 


-2 


2 





-1 




173 


2 


2 


1 





1 


-1 


-1 


1 


-1 


1 








1 


-3 





174 


-5 


7 


5 





-4 


-4 





-4 


-4 





-6 


-3 


1 


-4 


1 



STANFORD UNIVERSITY LIBRARY^ 

LIBRAKY. SCHeeirOF EDUCATION 

To avoid fine, this book should be returned on 
or before the date last stamped below 




■Ml «^J J 4 



fK,: 12 ^' 







% 



^'< % 



C7ZH 
V.1I 



3 bios ODb s^•^ asb 




i 




